[ 523.500017] env[66414]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 523.500017] env[66414]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 524.497072] env[66502]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 524.497072] env[66502]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 526.054957] env[66502]: INFO neutron.common.config [-] Logging enabled! [ 526.055405] env[66502]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 28.0.0.0b2.dev9 [ 526.055568] env[66502]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=66502) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 526.055848] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 526.055941] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 526.056786] env[66502]: WARNING oslo_policy.policy [None req-66794694-e545-4c92-919d-d33a88dc486f None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 526.056985] env[66502]: WARNING oslo_policy.policy [None req-66794694-e545-4c92-919d-d33a88dc486f None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 526.058696] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-66794694-e545-4c92-919d-d33a88dc486f None None] VMware NSXv3 Agent initialized successfully. [ 526.059059] env[66502]: DEBUG oslo_concurrency.lockutils [None req-66794694-e545-4c92-919d-d33a88dc486f None None] Acquiring lock "singleton_lock" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 526.059194] env[66502]: DEBUG oslo_concurrency.lockutils [None req-66794694-e545-4c92-919d-d33a88dc486f None None] Acquired lock "singleton_lock" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 526.059394] env[66502]: DEBUG oslo_concurrency.lockutils [None req-66794694-e545-4c92-919d-d33a88dc486f None None] Releasing lock "singleton_lock" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 526.059685] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] Full set of CONF: {{(pid=66502) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 526.059794] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] ******************************************************************************** {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 526.059907] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] Configuration options gathered from: {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 526.060256] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 526.060445] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 526.060550] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] ================================================================================ {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 526.060713] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] agent_down_time = 75 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.060847] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] allow_automatic_dhcp_failover = True {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.060976] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] allow_bulk = True {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.061128] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] api_extensions_path = {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.061263] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] api_paste_config = api-paste.ini {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.061398] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] auth_strategy = keystone {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.061502] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] backdoor_port = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.061592] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] backdoor_socket = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.061726] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] backlog = 4096 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.061856] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] base_mac = fa:16:3e:00:00:00 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.062021] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] bind_host = 0.0.0.0 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.062238] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] bind_port = 9696 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.062409] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] client_socket_timeout = 900 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.062545] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] config_dir = [] {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.062643] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.062806] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] config_source = [] {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.062942] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] control_exchange = neutron {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.063089] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] core_plugin = ml2 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.063224] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] debug = True {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.063358] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] default_availability_zones = [] {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.063559] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.063686] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] dhcp_agent_notification = True {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.063823] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] dhcp_agents_per_network = 1 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.063950] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] dhcp_lease_duration = 86400 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.064102] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] dhcp_load_type = networks {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.064266] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] dns_domain = openstacklocal {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.064399] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.064528] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] enable_default_route_bfd = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.064655] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] enable_default_route_ecmp = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.064782] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] enable_dvr = True {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.064909] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] enable_new_agents = True {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.065052] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] enable_services_on_agents_with_admin_state_down = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.065184] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] enable_signals = True {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.065375] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] enable_traditional_dhcp = True {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.065528] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] external_dns_driver = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.065660] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] filter_validation = True {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.065800] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] global_physnet_mtu = 8950 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.065931] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] graceful_shutdown_timeout = 60 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.066120] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] host = cpu-1 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.066257] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] host_dvr_for_dhcp = True {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.066389] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] http_retries = 3 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.066530] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] instance_format = [instance: %(uuid)s] {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.066696] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.066837] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] ipam_driver = internal {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.066965] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] ipv6_pd_enabled = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.067106] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] l3_ha = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.067240] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.067374] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] l3_ha_network_physical_name = {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.067505] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] l3_ha_network_type = {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.067639] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] log_color = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.067771] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] log_config_append = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.067901] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.068038] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] log_dir = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.068168] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] log_file = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.068268] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] log_options = True {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.068398] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] log_rotate_interval = 1 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.068532] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] log_rotate_interval_type = days {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.068665] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] log_rotation_type = none {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.068767] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.068866] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.068999] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.069145] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.069246] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.069377] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] max_dns_nameservers = 5 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.069505] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] max_header_line = 16384 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.069632] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] max_l3_agents_per_router = 3 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.069757] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] max_logfile_count = 30 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.069886] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] max_logfile_size_mb = 200 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.070024] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] max_subnet_host_routes = 20 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.070164] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] my_ip = 10.180.1.21 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.070297] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] my_ipv6 = ::1 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.070426] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] network_auto_schedule = True {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.070549] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] network_link_prefix = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.070682] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.070815] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] notify_nova_on_port_data_changes = True {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.070945] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] notify_nova_on_port_status_changes = True {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.071089] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] pagination_max_limit = -1 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.071218] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] publish_errors = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.071345] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] rate_limit_burst = 0 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.071479] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] rate_limit_except_level = CRITICAL {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.071606] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] rate_limit_interval = 0 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.071733] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] retry_until_window = 30 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.071858] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] router_distributed = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.071985] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] rpc_resources_processing_step = 20 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.072150] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] rpc_response_max_timeout = 600 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.072301] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] rpc_response_timeout = 60 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.072433] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] send_events_interval = 2 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.072582] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] service_plugins = ['router'] {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.072720] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] setproctitle = on {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.072850] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] shell_completion = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.072983] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] state_path = /opt/stack/data/neutron {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.073136] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] syslog_log_facility = LOG_USER {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.073267] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] tcp_keepidle = 600 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.073404] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] transport_url = **** {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.073532] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] use_journal = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.073660] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] use_json = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.073786] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] use_ssl = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.073913] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] use_stderr = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.074058] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] use_syslog = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.074189] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] vlan_qinq = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.074343] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] vlan_transparent = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.074476] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] watch_log_file = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.074611] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] wsgi_default_pool_size = 100 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.074759] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] wsgi_keep_alive = True {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.074896] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.075037] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] wsgi_server_debug = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 526.075189] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_concurrency.disable_process_locking = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.075329] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.075470] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.075604] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.075739] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.075875] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.076015] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.076167] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] profiler.connection_string = messaging:// {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.076309] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] profiler.enabled = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.076447] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] profiler.es_doc_type = notification {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.076578] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] profiler.es_scroll_size = 10000 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.076713] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] profiler.es_scroll_time = 2m {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.076841] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] profiler.filter_error_trace = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.076975] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] profiler.hmac_keys = **** {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.077124] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] profiler.sentinel_service_name = mymaster {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.077267] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] profiler.socket_timeout = 0.1 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.077402] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] profiler.trace_requests = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.077532] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] profiler.trace_sqlalchemy = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.077675] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] profiler_jaeger.process_tags = {} {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.077806] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] profiler_jaeger.service_name_prefix = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.077937] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] profiler_otlp.service_name_prefix = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.078092] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_policy.enforce_new_defaults = True {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.078362] env[66502]: WARNING oslo_config.cfg [None req-66794694-e545-4c92-919d-d33a88dc486f None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 526.078509] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_policy.enforce_scope = True {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.078676] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_policy.policy_default_rule = default {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.078839] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.078984] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.079138] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.079269] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.079399] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.079528] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.079657] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.079797] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_policy.remote_timeout = 60.0 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.080272] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.080272] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] agent.extensions = [] {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.080272] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.080371] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] service_providers.service_provider = [] {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.080495] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] QUOTAS.default_quota = -1 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.080636] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.080767] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] QUOTAS.quota_floatingip = 50 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.080898] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] QUOTAS.quota_network = 100 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.081038] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] QUOTAS.quota_port = 500 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.081169] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] QUOTAS.quota_rbac_policy = 10 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.081296] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] QUOTAS.quota_router = 10 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.081433] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] QUOTAS.quota_security_group = 10 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.081549] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] QUOTAS.quota_security_group_rule = 100 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.081677] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] QUOTAS.quota_subnet = 100 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.081802] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] QUOTAS.track_quota_usage = True {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.081942] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.082087] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] privsep.group = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.082242] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] privsep.helper_command = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.082378] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] privsep.log_daemon_traceback = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.082516] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] privsep.logger_name = oslo_privsep.daemon {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.082648] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] privsep.thread_pool_size = 8 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.082778] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] privsep.user = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.082919] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.083060] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] privsep_dhcp_release.group = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.083191] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] privsep_dhcp_release.helper_command = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.083323] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.083456] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.083584] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.083711] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] privsep_dhcp_release.user = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.083848] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.083975] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] privsep_ovs_vsctl.group = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.084114] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] privsep_ovs_vsctl.helper_command = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.084298] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.084454] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.084590] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.084722] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] privsep_ovs_vsctl.user = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.084857] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] privsep_namespace.capabilities = [21] {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.084990] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] privsep_namespace.group = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.085128] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] privsep_namespace.helper_command = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.085259] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] privsep_namespace.log_daemon_traceback = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.085420] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.085560] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] privsep_namespace.thread_pool_size = 8 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.085690] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] privsep_namespace.user = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.085827] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] privsep_conntrack.capabilities = [12] {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.085953] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] privsep_conntrack.group = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.086169] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] privsep_conntrack.helper_command = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.086310] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] privsep_conntrack.log_daemon_traceback = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.086448] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.086607] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] privsep_conntrack.thread_pool_size = 8 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.086746] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] privsep_conntrack.user = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.086886] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] privsep_link.capabilities = [12, 21] {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.087025] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] privsep_link.group = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.087153] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] privsep_link.helper_command = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.087285] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] privsep_link.log_daemon_traceback = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.087500] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.087638] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] privsep_link.thread_pool_size = 8 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.087763] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] privsep_link.user = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.087912] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.088067] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.088205] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] AGENT.continue_on_failed_promotions = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.088337] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] AGENT.dscp = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.088472] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] AGENT.dscp_inherit = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.088610] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] AGENT.force_mp_to_policy = True {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.088741] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] AGENT.locking_coordinator_url = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.088870] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] AGENT.log_agent_heartbeats = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.089017] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] AGENT.logging_expire = 1 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.089153] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.089287] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.089427] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] AGENT.polling_interval = 240 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.089564] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.089693] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] AGENT.quitting_rpc_timeout = 120 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.089832] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] AGENT.report_interval = 30.0 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.089969] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.090115] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.090250] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.090386] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] AGENT.sync_skew = 60 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.090518] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] AGENT.synchronization_queue_size = 20 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.090657] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] AGENT.use_helper_for_ns_read = True {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.090824] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] SECURITYGROUP.enable_ipset = True {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.090969] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] SECURITYGROUP.enable_security_group = True {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.091121] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.091260] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.091400] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] experimental.ipv6_pd_enabled = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.091551] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] ml2.extension_drivers = ['port_security'] {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.091681] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] ml2.external_network_type = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.091824] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.091963] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] ml2.overlay_ip_version = 4 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.092124] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] ml2.path_mtu = 8950 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.092273] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] ml2.physical_network_mtus = {} {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.092418] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] ml2.tenant_network_types = ['vlan'] {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.092555] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.092692] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] ml2.type_drivers = ['vlan'] {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.092831] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] AGENT_CLI.neutron_port_id = [] {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.092959] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.093103] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.093245] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.093385] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.093518] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.093653] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.093790] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.093924] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.094133] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.094337] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] NSXV3.nsxv3_login_password = **** {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.094492] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] NSXV3.nsxv3_login_port = 443 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.094628] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] NSXV3.nsxv3_login_user = admin {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.094770] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.094912] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.095057] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.095222] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.095332] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.095473] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.095609] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.095743] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.095877] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.096023] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.096164] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.096330] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.096475] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.096669] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.096815] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] vsphere.vsphere_login_password = VMware1! {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.096954] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.097103] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.097241] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] nova.auth_section = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.097383] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] nova.auth_type = password {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.097518] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.097648] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] nova.certfile = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.097796] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] nova.collect_timing = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.097943] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] nova.endpoint_type = public {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.098088] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] nova.insecure = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.098220] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] nova.keyfile = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.098358] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] nova.region_name = RegionOne {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.098487] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] nova.split_loggers = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.098615] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] nova.timeout = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.098748] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] placement.auth_section = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.098886] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] placement.auth_type = password {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.099033] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.099161] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] placement.certfile = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.099290] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] placement.collect_timing = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.099426] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] placement.endpoint_type = public {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.099553] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] placement.insecure = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.099689] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] placement.keyfile = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.099815] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] placement.region_name = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.099942] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] placement.split_loggers = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.100079] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] placement.timeout = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.100214] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] ironic.auth_section = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.100346] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] ironic.auth_type = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.100471] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] ironic.cafile = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.100596] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] ironic.certfile = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.100726] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] ironic.collect_timing = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.100852] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] ironic.connect_retries = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.100976] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] ironic.connect_retry_delay = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.101119] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] ironic.enable_notifications = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.101245] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] ironic.endpoint_override = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.101375] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] ironic.insecure = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.101500] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] ironic.interface = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.101626] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] ironic.keyfile = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.101755] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] ironic.max_version = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.101878] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] ironic.min_version = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.102008] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] ironic.region_name = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.102171] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] ironic.retriable_status_codes = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.102306] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] ironic.service_name = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.102442] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] ironic.service_type = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.102571] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] ironic.split_loggers = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.102710] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] ironic.status_code_retries = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.102874] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] ironic.status_code_retry_delay = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.103015] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] ironic.timeout = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.103152] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] ironic.valid_interfaces = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.103283] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] ironic.version = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.103421] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] cli_script.dry_run = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.103564] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.103708] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.103841] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.103974] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.104115] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.104298] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.104401] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.104530] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.104662] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.104800] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.104927] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.105075] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.105220] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.105351] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.105482] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.105618] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.105747] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.105874] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.106027] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.106151] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.106280] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.106409] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.106558] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.106703] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.106835] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.106969] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.107114] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.107248] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.107378] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.107509] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.107637] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_rabbit.ssl = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.107787] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.107923] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.108061] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.108208] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.108380] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_rabbit.ssl_version = {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.108746] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.108746] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_notifications.driver = [] {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.108810] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_notifications.retry = -1 {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.108933] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.109072] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] oslo_messaging_notifications.transport_url = **** {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 526.109174] env[66502]: DEBUG oslo_service.backend._eventlet.service [None req-66794694-e545-4c92-919d-d33a88dc486f None None] ******************************************************************************** {{(pid=66502) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 526.110308] env[66502]: DEBUG neutron.agent.securitygroups_rpc [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Init firewall settings (driver=nsxv3) {{(pid=66502) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 526.111594] env[66502]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=66502) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 526.111839] env[66502]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] RPC agent_id: nsxm-l-01a.corp.local [ 526.114048] env[66502]: DEBUG dogpile.cache.region [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 526.114169] env[66502]: DEBUG dogpile.lock [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 526.114285] env[66502]: DEBUG dogpile.lock [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 526.114377] env[66502]: DEBUG dogpile.lock [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 526.114469] env[66502]: DEBUG dogpile.cache.region [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 526.114555] env[66502]: DEBUG dogpile.lock [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 526.114674] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 526.161873] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Session token - acquiring [ 526.163094] env[66502]: DEBUG networking_nsxv3.common.locking [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 526.163281] env[66502]: DEBUG oslo_concurrency.lockutils [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 526.163775] env[66502]: DEBUG oslo_concurrency.lockutils [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 526.163877] env[66502]: DEBUG oslo_concurrency.lockutils [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 526.177409] env[66502]: DEBUG oslo_concurrency.lockutils [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 526.462767] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 526.490641] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 526.490845] env[66502]: DEBUG dogpile.cache.region [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Cache value generated in 0.376 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 526.490984] env[66502]: DEBUG dogpile.lock [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 526.491075] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Activating Policy API Provider. [ 526.491220] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Looking for the default Infrastructure Rules. [ 526.568168] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Looking for the Default Layer3 Logged Drop Section. [ 526.586989] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 526.587489] env[66502]: DEBUG networking_nsxv3.common.locking [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 526.587686] env[66502]: DEBUG oslo_concurrency.lockutils [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Acquiring lock "all" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 526.587757] env[66502]: DEBUG oslo_concurrency.lockutils [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Acquired lock "all" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 526.588066] env[66502]: DEBUG oslo_concurrency.lockutils [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Acquired external semaphore "all" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 526.588474] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 527.103662] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 527.607139] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 528.110870] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Inventory metadata is going to be refreshed. [ 528.110870] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 528.842774] env[66502]: DEBUG networking_nsxv3.common.locking [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.843130] env[66502]: DEBUG oslo_concurrency.lockutils [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 528.843130] env[66502]: DEBUG oslo_concurrency.lockutils [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 528.843392] env[66502]: DEBUG oslo_concurrency.lockutils [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 528.855250] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 528.856101] env[66502]: DEBUG oslo_concurrency.lockutils [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 528.856683] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 528.872889] env[66502]: DEBUG networking_nsxv3.common.locking [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.873207] env[66502]: DEBUG oslo_concurrency.lockutils [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 528.873207] env[66502]: DEBUG oslo_concurrency.lockutils [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 528.873442] env[66502]: DEBUG oslo_concurrency.lockutils [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 528.873565] env[66502]: DEBUG oslo_concurrency.lockutils [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 528.873705] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 528.873817] env[66502]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=66502) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 528.873916] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 528.892802] env[66502]: DEBUG networking_nsxv3.common.locking [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.893083] env[66502]: DEBUG oslo_concurrency.lockutils [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 528.893083] env[66502]: DEBUG oslo_concurrency.lockutils [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 528.893419] env[66502]: DEBUG oslo_concurrency.lockutils [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 528.893592] env[66502]: DEBUG oslo_concurrency.lockutils [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 528.893734] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 528.915171] env[66502]: DEBUG networking_nsxv3.common.locking [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.915469] env[66502]: DEBUG oslo_concurrency.lockutils [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 528.915469] env[66502]: DEBUG oslo_concurrency.lockutils [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 528.915742] env[66502]: DEBUG oslo_concurrency.lockutils [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 528.915884] env[66502]: DEBUG oslo_concurrency.lockutils [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 528.916033] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 528.934777] env[66502]: DEBUG networking_nsxv3.common.locking [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.935112] env[66502]: DEBUG oslo_concurrency.lockutils [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Acquiring lock "Address Group" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 528.935112] env[66502]: DEBUG oslo_concurrency.lockutils [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Acquired lock "Address Group" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 528.935499] env[66502]: DEBUG oslo_concurrency.lockutils [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Acquired external semaphore "Address Group" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 528.935663] env[66502]: DEBUG oslo_concurrency.lockutils [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Releasing lock "Address Group" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 528.935823] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 528.935930] env[66502]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=66502) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 528.936049] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 528.955463] env[66502]: DEBUG networking_nsxv3.common.locking [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.955691] env[66502]: DEBUG oslo_concurrency.lockutils [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Acquiring lock "Segment QoS" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 528.955737] env[66502]: DEBUG oslo_concurrency.lockutils [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Acquired lock "Segment QoS" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 528.956026] env[66502]: DEBUG oslo_concurrency.lockutils [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Acquired external semaphore "Segment QoS" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 528.956139] env[66502]: DEBUG oslo_concurrency.lockutils [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Releasing lock "Segment QoS" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 528.956279] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 528.956384] env[66502]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=66502) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 528.956488] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 528.975428] env[66502]: DEBUG networking_nsxv3.common.locking [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 528.975634] env[66502]: DEBUG oslo_concurrency.lockutils [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 528.975753] env[66502]: DEBUG oslo_concurrency.lockutils [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 528.975975] env[66502]: DEBUG oslo_concurrency.lockutils [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 528.976131] env[66502]: DEBUG oslo_concurrency.lockutils [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 528.976363] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 528.976469] env[66502]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66502) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 528.976583] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Inventory metadata have been refreshed. [ 528.976684] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Dryrun:True. Metadata refresh completed. [ 528.976799] env[66502]: DEBUG oslo_concurrency.lockutils [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Releasing lock "all" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 528.983796] env[66502]: INFO neutron.agent.agent_extensions_manager [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Loaded agent extensions: [] [ 528.984594] env[66502]: DEBUG neutron_lib.callbacks.manager [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=66502) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 529.038916] env[66502]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] NSXv3 Agent Agent RPC Daemon Started! [ 529.039068] env[66502]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] NSXv3 Agent Agent loop - iteration:0 started [ 529.039133] env[66502]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] NSXv3 Agent Agent out of sync with plugin! [ 533.985729] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 533.986145] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 538.987582] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 538.987582] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 541.896817] env[66502]: INFO networking_nsxv3.common.synchronization [None req-3d742365-aa06-4800-89be-c9238471d79e demo admin] Enqueued Resource ID: 30d46828-db16-4c18-be35-cd4f4b598c1c with Priority: HIGHEST for action security_group_rules [ 541.897463] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 30d46828-db16-4c18-be35-cd4f4b598c1c with Priority: HIGHEST for action security_group_rules [ 541.897859] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-30d46828-db16-4c18-be35-cd4f4b598c1c taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 541.898037] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-30d46828-db16-4c18-be35-cd4f4b598c1c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 541.898135] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-30d46828-db16-4c18-be35-cd4f4b598c1c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 541.898568] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-30d46828-db16-4c18-be35-cd4f4b598c1c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 541.898725] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('30d46828-db16-4c18-be35-cd4f4b598c1c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 542.419198] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 542.419534] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 542.419534] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 542.419664] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 542.419720] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 542.419772] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 30d46828-db16-4c18-be35-cd4f4b598c1c already deleted. [ 542.419851] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-30d46828-db16-4c18-be35-cd4f4b598c1c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 546.898876] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 546.899299] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 551.899930] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 551.900383] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 556.901727] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 556.902139] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 561.907158] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 561.907158] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 566.904138] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 566.904409] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 571.905145] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 571.905813] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 571.958648] env[66502]: INFO networking_nsxv3.common.synchronization [None req-232f9080-820c-4523-86db-09457bfdf498 None None] Enqueued Resource ID: d549d1d7-3cd9-4d74-a141-3b7586a3afe7 with Priority: HIGHEST for action port [ 571.958861] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d549d1d7-3cd9-4d74-a141-3b7586a3afe7 with Priority: HIGHEST for action port [ 571.959951] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-d549d1d7-3cd9-4d74-a141-3b7586a3afe7 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 571.959951] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d549d1d7-3cd9-4d74-a141-3b7586a3afe7" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 571.959951] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d549d1d7-3cd9-4d74-a141-3b7586a3afe7" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 571.959951] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d549d1d7-3cd9-4d74-a141-3b7586a3afe7" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 571.959951] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d549d1d7-3cd9-4d74-a141-3b7586a3afe7',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.267567] env[66502]: INFO networking_nsxv3.common.synchronization [None req-0007b4d9-4bd8-4b78-bbfa-9bd5ab3fc7e1 None None] Enqueued Resource ID: a41a63a4-f183-4aae-9b6d-294d4a21b796 with Priority: HIGHEST for action port [ 572.269301] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a41a63a4-f183-4aae-9b6d-294d4a21b796 with Priority: HIGHEST for action port [ 572.269301] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-a41a63a4-f183-4aae-9b6d-294d4a21b796 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.269301] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a41a63a4-f183-4aae-9b6d-294d4a21b796" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.269301] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a41a63a4-f183-4aae-9b6d-294d4a21b796" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.269301] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a41a63a4-f183-4aae-9b6d-294d4a21b796" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.269301] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a41a63a4-f183-4aae-9b6d-294d4a21b796',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 572.464548] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d549d1d7-3cd9-4d74-a141-3b7586a3afe7 [ 572.464548] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.464700] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.464700] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.464994] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.464994] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.465129] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d549d1d7-3cd9-4d74-a141-3b7586a3afe7 already deleted. [ 572.465129] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d549d1d7-3cd9-4d74-a141-3b7586a3afe7" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.773343] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a41a63a4-f183-4aae-9b6d-294d4a21b796 [ 572.773343] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 572.773343] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 572.773343] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 572.773343] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 572.773343] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 572.773343] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a41a63a4-f183-4aae-9b6d-294d4a21b796 already deleted. [ 572.773594] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a41a63a4-f183-4aae-9b6d-294d4a21b796" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 574.987626] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 574.987963] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 574.987963] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 574.988107] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 574.988331] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.065520] env[66502]: INFO networking_nsxv3.common.synchronization [None req-8568a19c-fb5f-4831-bf7d-5cfdda0a2d67 None None] Enqueued Resource ID: f54e0dd5-36d8-4a19-9898-af53138897f2 with Priority: HIGHEST for action port [ 575.068338] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f54e0dd5-36d8-4a19-9898-af53138897f2 with Priority: HIGHEST for action port [ 575.068338] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-f54e0dd5-36d8-4a19-9898-af53138897f2 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.068338] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f54e0dd5-36d8-4a19-9898-af53138897f2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.068338] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f54e0dd5-36d8-4a19-9898-af53138897f2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.068338] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f54e0dd5-36d8-4a19-9898-af53138897f2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.068338] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f54e0dd5-36d8-4a19-9898-af53138897f2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.086741] env[66502]: INFO networking_nsxv3.common.synchronization [None req-fabae010-596e-488c-87f7-4fda7bf4e3fa None None] Enqueued Resource ID: df96bbe8-2616-4a5a-b73b-38c121ea90e9 with Priority: HIGHEST for action port [ 575.087296] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df96bbe8-2616-4a5a-b73b-38c121ea90e9 with Priority: HIGHEST for action port [ 575.087567] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-df96bbe8-2616-4a5a-b73b-38c121ea90e9 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.087687] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df96bbe8-2616-4a5a-b73b-38c121ea90e9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.087749] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df96bbe8-2616-4a5a-b73b-38c121ea90e9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.087992] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df96bbe8-2616-4a5a-b73b-38c121ea90e9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.088526] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df96bbe8-2616-4a5a-b73b-38c121ea90e9',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.492141] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.570419] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f54e0dd5-36d8-4a19-9898-af53138897f2 [ 575.570604] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.570759] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.570819] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.571028] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.571116] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.571210] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f54e0dd5-36d8-4a19-9898-af53138897f2 already deleted. [ 575.571286] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f54e0dd5-36d8-4a19-9898-af53138897f2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.594463] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df96bbe8-2616-4a5a-b73b-38c121ea90e9 [ 575.594874] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.595922] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.595922] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.595922] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.595922] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.595922] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df96bbe8-2616-4a5a-b73b-38c121ea90e9 already deleted. [ 575.595922] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df96bbe8-2616-4a5a-b73b-38c121ea90e9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.995199] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.180591] env[66502]: INFO networking_nsxv3.common.synchronization [None req-88b5ca1c-c96b-46ed-a3f2-640a3a095bce None None] Enqueued Resource ID: d72d2f7b-0e71-4837-b22a-0b992cb64138 with Priority: HIGHEST for action port [ 576.182277] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d72d2f7b-0e71-4837-b22a-0b992cb64138 with Priority: HIGHEST for action port [ 576.183477] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-d72d2f7b-0e71-4837-b22a-0b992cb64138 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.183600] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d72d2f7b-0e71-4837-b22a-0b992cb64138" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.183721] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d72d2f7b-0e71-4837-b22a-0b992cb64138" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.184400] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d72d2f7b-0e71-4837-b22a-0b992cb64138" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.185629] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d72d2f7b-0e71-4837-b22a-0b992cb64138',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.497556] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 576.497651] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 576.690635] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d72d2f7b-0e71-4837-b22a-0b992cb64138 [ 576.690635] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.690635] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.690635] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.690635] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.691156] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.691201] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d72d2f7b-0e71-4837-b22a-0b992cb64138 already deleted. [ 576.691357] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d72d2f7b-0e71-4837-b22a-0b992cb64138" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.000477] env[66502]: INFO networking_nsxv3.common.synchronization [None req-395107d2-0ffb-4192-b3d5-4267cae304f9 None None] Enqueued Resource ID: 06ef62e2-188d-4419-85d8-f57891bfcd07 with Priority: HIGHEST for action port [ 577.001817] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 06ef62e2-188d-4419-85d8-f57891bfcd07 with Priority: HIGHEST for action port [ 577.001817] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-06ef62e2-188d-4419-85d8-f57891bfcd07 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.001817] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-06ef62e2-188d-4419-85d8-f57891bfcd07" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.001817] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-06ef62e2-188d-4419-85d8-f57891bfcd07" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.001817] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-06ef62e2-188d-4419-85d8-f57891bfcd07" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.002060] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('06ef62e2-188d-4419-85d8-f57891bfcd07',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.335164] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.335164] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.335164] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.335164] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.346679] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 577.347565] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.348627] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 577.373021] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.373021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.373021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.373021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.373021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.373021] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 577.373021] env[66502]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66502) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 577.373021] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 577.394866] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.395553] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.396318] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.396318] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.396318] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.396318] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 577.417704] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.420020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.420020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.420020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.420020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.420020] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 577.444651] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.445631] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.445631] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.446990] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.446990] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.446990] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 577.446990] env[66502]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=66502) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 577.446990] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 577.468305] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.468305] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.468305] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.468305] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.468305] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.468305] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 577.468305] env[66502]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66502) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 577.468305] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 577.488044] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.488044] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.488044] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.488044] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.488346] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.488346] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 577.488346] env[66502]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66502) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 577.488428] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 577.488428] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 577.488519] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 577.488578] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 577.488640] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 577.488902] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 577.488962] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 577.489071] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 577.505482] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 06ef62e2-188d-4419-85d8-f57891bfcd07 [ 577.505482] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.505482] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.505691] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.506106] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.506251] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.506379] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:06ef62e2-188d-4419-85d8-f57891bfcd07 already deleted. [ 577.506500] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-06ef62e2-188d-4419-85d8-f57891bfcd07" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.513284] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.513442] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.513485] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.513678] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.513812] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.513893] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 577.534230] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.534396] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.534459] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.534662] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.534767] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.549263] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.675262] env[66502]: INFO networking_nsxv3.common.synchronization [None req-ba7a12d8-3586-4a03-a241-8204bffd0760 None None] Enqueued Resource ID: 6bc9c57e-0e20-4ac2-bf61-6d4e1e9fc7c8 with Priority: HIGHEST for action port [ 577.675749] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6bc9c57e-0e20-4ac2-bf61-6d4e1e9fc7c8 with Priority: HIGHEST for action port [ 577.676440] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-6bc9c57e-0e20-4ac2-bf61-6d4e1e9fc7c8 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.676440] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6bc9c57e-0e20-4ac2-bf61-6d4e1e9fc7c8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.676440] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6bc9c57e-0e20-4ac2-bf61-6d4e1e9fc7c8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.677349] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6bc9c57e-0e20-4ac2-bf61-6d4e1e9fc7c8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.677445] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6bc9c57e-0e20-4ac2-bf61-6d4e1e9fc7c8',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.180563] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6bc9c57e-0e20-4ac2-bf61-6d4e1e9fc7c8 [ 578.180818] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.180926] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.180987] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.181221] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.181441] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.181441] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6bc9c57e-0e20-4ac2-bf61-6d4e1e9fc7c8 already deleted. [ 578.182387] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6bc9c57e-0e20-4ac2-bf61-6d4e1e9fc7c8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.468948] env[66502]: INFO networking_nsxv3.common.synchronization [None req-e68d3cf9-5487-42ee-9f5d-c903fb214b26 None None] Enqueued Resource ID: 7af6dfc6-c78a-4d0b-8cb4-120f85bf7b7c with Priority: HIGHEST for action port [ 578.469478] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7af6dfc6-c78a-4d0b-8cb4-120f85bf7b7c with Priority: HIGHEST for action port [ 578.469770] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-7af6dfc6-c78a-4d0b-8cb4-120f85bf7b7c taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.469878] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7af6dfc6-c78a-4d0b-8cb4-120f85bf7b7c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.469959] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7af6dfc6-c78a-4d0b-8cb4-120f85bf7b7c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.470283] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7af6dfc6-c78a-4d0b-8cb4-120f85bf7b7c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.470425] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7af6dfc6-c78a-4d0b-8cb4-120f85bf7b7c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.646311] env[66502]: INFO networking_nsxv3.common.synchronization [None req-f0345f2f-6ef1-4484-917c-cc9aef0897ab None None] Enqueued Resource ID: deb560f1-b3f6-4934-929a-8f3416d4fc6b with Priority: HIGHEST for action port [ 578.646311] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: deb560f1-b3f6-4934-929a-8f3416d4fc6b with Priority: HIGHEST for action port [ 578.646450] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-deb560f1-b3f6-4934-929a-8f3416d4fc6b taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.646522] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-deb560f1-b3f6-4934-929a-8f3416d4fc6b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.646603] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-deb560f1-b3f6-4934-929a-8f3416d4fc6b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.647368] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-deb560f1-b3f6-4934-929a-8f3416d4fc6b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.647368] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('deb560f1-b3f6-4934-929a-8f3416d4fc6b',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.976883] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7af6dfc6-c78a-4d0b-8cb4-120f85bf7b7c [ 578.976883] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.977039] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.977039] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.977272] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.977359] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.977516] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7af6dfc6-c78a-4d0b-8cb4-120f85bf7b7c already deleted. [ 578.977516] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7af6dfc6-c78a-4d0b-8cb4-120f85bf7b7c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.152851] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port deb560f1-b3f6-4934-929a-8f3416d4fc6b [ 579.153167] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.153301] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.153378] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.153599] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.153690] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.153783] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:deb560f1-b3f6-4934-929a-8f3416d4fc6b already deleted. [ 579.153862] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-deb560f1-b3f6-4934-929a-8f3416d4fc6b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.233743] env[66502]: INFO networking_nsxv3.common.synchronization [None req-4249be1c-344e-4f2b-8ae9-3b1408dae629 None None] Enqueued Resource ID: 9cc2b9f2-9b35-402e-86b1-752aa848fa78 with Priority: HIGHEST for action port [ 579.234079] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cc2b9f2-9b35-402e-86b1-752aa848fa78 with Priority: HIGHEST for action port [ 579.234628] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-9cc2b9f2-9b35-402e-86b1-752aa848fa78 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.234729] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9cc2b9f2-9b35-402e-86b1-752aa848fa78" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.234786] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9cc2b9f2-9b35-402e-86b1-752aa848fa78" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.236545] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9cc2b9f2-9b35-402e-86b1-752aa848fa78" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.236545] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cc2b9f2-9b35-402e-86b1-752aa848fa78',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 579.738938] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9cc2b9f2-9b35-402e-86b1-752aa848fa78 [ 579.739188] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.739323] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.739392] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.739607] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.739699] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.739793] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9cc2b9f2-9b35-402e-86b1-752aa848fa78 already deleted. [ 579.739872] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9cc2b9f2-9b35-402e-86b1-752aa848fa78" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.343976] env[66502]: INFO networking_nsxv3.common.synchronization [None req-cd18e254-84c9-4d81-9d4f-712843a13159 None None] Enqueued Resource ID: 5e8f31c6-9167-4fa4-a043-804d72ebfd62 with Priority: HIGHEST for action port [ 580.343976] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5e8f31c6-9167-4fa4-a043-804d72ebfd62 with Priority: HIGHEST for action port [ 580.343976] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-5e8f31c6-9167-4fa4-a043-804d72ebfd62 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.343976] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5e8f31c6-9167-4fa4-a043-804d72ebfd62" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.343976] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5e8f31c6-9167-4fa4-a043-804d72ebfd62" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.344420] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5e8f31c6-9167-4fa4-a043-804d72ebfd62" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.345444] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5e8f31c6-9167-4fa4-a043-804d72ebfd62',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.395640] env[66502]: INFO networking_nsxv3.common.synchronization [None req-92fb0b9e-fa74-4cb4-90e1-18690c2a5584 None None] Enqueued Resource ID: f5307c19-5790-4445-b049-79d87dbedb00 with Priority: HIGHEST for action port [ 580.396950] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f5307c19-5790-4445-b049-79d87dbedb00 with Priority: HIGHEST for action port [ 580.397333] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-f5307c19-5790-4445-b049-79d87dbedb00 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.399897] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f5307c19-5790-4445-b049-79d87dbedb00" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.399897] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f5307c19-5790-4445-b049-79d87dbedb00" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.399897] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f5307c19-5790-4445-b049-79d87dbedb00" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.399897] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f5307c19-5790-4445-b049-79d87dbedb00',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.848320] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5e8f31c6-9167-4fa4-a043-804d72ebfd62 [ 580.851058] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.851058] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.851058] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.851058] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.851058] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.851058] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5e8f31c6-9167-4fa4-a043-804d72ebfd62 already deleted. [ 580.851058] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5e8f31c6-9167-4fa4-a043-804d72ebfd62" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.900897] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f5307c19-5790-4445-b049-79d87dbedb00 [ 580.901143] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.901277] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.901343] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.902837] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.902837] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.902837] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f5307c19-5790-4445-b049-79d87dbedb00 already deleted. [ 580.902837] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f5307c19-5790-4445-b049-79d87dbedb00" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.478916] env[66502]: INFO networking_nsxv3.common.synchronization [None req-fdb8abf6-6c1a-4cf1-8bc9-a97f67d90231 None None] Enqueued Resource ID: 02519cb9-4205-423e-83e0-e9b57746ffaa with Priority: HIGHEST for action port [ 581.478916] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02519cb9-4205-423e-83e0-e9b57746ffaa with Priority: HIGHEST for action port [ 581.478916] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-02519cb9-4205-423e-83e0-e9b57746ffaa taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.480078] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02519cb9-4205-423e-83e0-e9b57746ffaa" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.480078] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02519cb9-4205-423e-83e0-e9b57746ffaa" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.480078] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02519cb9-4205-423e-83e0-e9b57746ffaa" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.480078] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02519cb9-4205-423e-83e0-e9b57746ffaa',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.706876] env[66502]: INFO networking_nsxv3.common.synchronization [None req-c98df98f-59ea-411e-9fd7-866c3682eb9c None None] Enqueued Resource ID: 76354bad-273d-4486-bba9-1155c3c9993c with Priority: HIGHEST for action port [ 581.707480] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76354bad-273d-4486-bba9-1155c3c9993c with Priority: HIGHEST for action port [ 581.707795] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-76354bad-273d-4486-bba9-1155c3c9993c taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.708738] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-76354bad-273d-4486-bba9-1155c3c9993c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.708830] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-76354bad-273d-4486-bba9-1155c3c9993c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.709128] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-76354bad-273d-4486-bba9-1155c3c9993c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.709889] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76354bad-273d-4486-bba9-1155c3c9993c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 581.983326] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 02519cb9-4205-423e-83e0-e9b57746ffaa [ 581.983326] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 581.983326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 581.983326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 581.984571] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 581.984689] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 581.984798] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:02519cb9-4205-423e-83e0-e9b57746ffaa already deleted. [ 581.984884] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02519cb9-4205-423e-83e0-e9b57746ffaa" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.211094] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 76354bad-273d-4486-bba9-1155c3c9993c [ 582.211336] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.211469] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.213043] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.213043] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.213043] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.213043] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:76354bad-273d-4486-bba9-1155c3c9993c already deleted. [ 582.213043] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-76354bad-273d-4486-bba9-1155c3c9993c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.767795] env[66502]: INFO networking_nsxv3.common.synchronization [None req-b7aee139-952e-41f8-9899-5649302971c0 None None] Enqueued Resource ID: f14b1d8c-4f42-4d1a-99d8-e0a6cb1fb9c7 with Priority: HIGHEST for action port [ 582.768393] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f14b1d8c-4f42-4d1a-99d8-e0a6cb1fb9c7 with Priority: HIGHEST for action port [ 582.768763] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-f14b1d8c-4f42-4d1a-99d8-e0a6cb1fb9c7 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.768884] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f14b1d8c-4f42-4d1a-99d8-e0a6cb1fb9c7" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.768979] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f14b1d8c-4f42-4d1a-99d8-e0a6cb1fb9c7" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.769253] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f14b1d8c-4f42-4d1a-99d8-e0a6cb1fb9c7" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.769343] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f14b1d8c-4f42-4d1a-99d8-e0a6cb1fb9c7',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.272780] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f14b1d8c-4f42-4d1a-99d8-e0a6cb1fb9c7 [ 583.272780] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.273879] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.273879] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.274522] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.276255] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.276255] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f14b1d8c-4f42-4d1a-99d8-e0a6cb1fb9c7 already deleted. [ 583.276255] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f14b1d8c-4f42-4d1a-99d8-e0a6cb1fb9c7" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.464055] env[66502]: INFO networking_nsxv3.common.synchronization [None req-7e0b2ad2-2d83-43db-a119-5c47ba19fc95 None None] Enqueued Resource ID: 77af92b4-bb10-41a5-945d-aea71db347a1 with Priority: HIGHEST for action port [ 583.464861] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77af92b4-bb10-41a5-945d-aea71db347a1 with Priority: HIGHEST for action port [ 583.465180] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-77af92b4-bb10-41a5-945d-aea71db347a1 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.465304] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77af92b4-bb10-41a5-945d-aea71db347a1" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.465414] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77af92b4-bb10-41a5-945d-aea71db347a1" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.465697] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77af92b4-bb10-41a5-945d-aea71db347a1" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.467623] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77af92b4-bb10-41a5-945d-aea71db347a1',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.970378] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 77af92b4-bb10-41a5-945d-aea71db347a1 [ 583.970985] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.970985] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.970985] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.971235] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.971235] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.971235] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:77af92b4-bb10-41a5-945d-aea71db347a1 already deleted. [ 583.971443] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77af92b4-bb10-41a5-945d-aea71db347a1" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.162581] env[66502]: INFO networking_nsxv3.common.synchronization [None req-ad9e5f5a-1226-464a-b610-e3730361d7ed None None] Enqueued Resource ID: cf8e6e41-0bb9-4e30-b014-851f42221689 with Priority: HIGHEST for action port [ 585.162887] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cf8e6e41-0bb9-4e30-b014-851f42221689 with Priority: HIGHEST for action port [ 585.163394] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-cf8e6e41-0bb9-4e30-b014-851f42221689 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.163507] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cf8e6e41-0bb9-4e30-b014-851f42221689" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.163570] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cf8e6e41-0bb9-4e30-b014-851f42221689" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.163812] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cf8e6e41-0bb9-4e30-b014-851f42221689" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.163901] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cf8e6e41-0bb9-4e30-b014-851f42221689',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.672149] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cf8e6e41-0bb9-4e30-b014-851f42221689 [ 585.672149] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.672149] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.672149] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.672149] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.672149] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.672149] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cf8e6e41-0bb9-4e30-b014-851f42221689 already deleted. [ 585.672149] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cf8e6e41-0bb9-4e30-b014-851f42221689" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.439548] env[66502]: INFO networking_nsxv3.common.synchronization [None req-da90a46c-c956-4983-9999-e26dc64fb252 None None] Enqueued Resource ID: e23091e3-84f3-4794-859e-8c9e85393bf1 with Priority: HIGHEST for action port [ 586.439548] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e23091e3-84f3-4794-859e-8c9e85393bf1 with Priority: HIGHEST for action port [ 586.440072] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-e23091e3-84f3-4794-859e-8c9e85393bf1 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.441478] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e23091e3-84f3-4794-859e-8c9e85393bf1" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.441478] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e23091e3-84f3-4794-859e-8c9e85393bf1" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.441909] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e23091e3-84f3-4794-859e-8c9e85393bf1" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.441909] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e23091e3-84f3-4794-859e-8c9e85393bf1',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.946328] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e23091e3-84f3-4794-859e-8c9e85393bf1 [ 586.946328] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.946720] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.946720] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.946780] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.946872] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.946961] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e23091e3-84f3-4794-859e-8c9e85393bf1 already deleted. [ 586.947221] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e23091e3-84f3-4794-859e-8c9e85393bf1" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.015473] env[66502]: INFO networking_nsxv3.common.synchronization [None req-c64dd630-dc29-4391-9694-bf99465b6f3d None None] Enqueued Resource ID: 8249b716-833a-41f7-a8f7-1cede431e234 with Priority: HIGHEST for action port [ 587.016076] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8249b716-833a-41f7-a8f7-1cede431e234 with Priority: HIGHEST for action port [ 587.016372] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-8249b716-833a-41f7-a8f7-1cede431e234 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.016519] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8249b716-833a-41f7-a8f7-1cede431e234" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.016551] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8249b716-833a-41f7-a8f7-1cede431e234" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.016797] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8249b716-833a-41f7-a8f7-1cede431e234" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.016880] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8249b716-833a-41f7-a8f7-1cede431e234',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.199766] env[66502]: INFO networking_nsxv3.common.synchronization [None req-82d2a15c-a243-4c3e-bd1d-af0276db594e None None] Enqueued Resource ID: 9eefdc80-04da-470c-a646-561ea7857b56 with Priority: HIGHEST for action port [ 587.200039] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9eefdc80-04da-470c-a646-561ea7857b56 with Priority: HIGHEST for action port [ 587.200604] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-9eefdc80-04da-470c-a646-561ea7857b56 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.200731] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9eefdc80-04da-470c-a646-561ea7857b56" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.200803] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9eefdc80-04da-470c-a646-561ea7857b56" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.201128] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9eefdc80-04da-470c-a646-561ea7857b56" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.201222] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9eefdc80-04da-470c-a646-561ea7857b56',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.520672] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8249b716-833a-41f7-a8f7-1cede431e234 [ 587.521173] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.521173] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.521173] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.521328] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.521399] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.521523] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8249b716-833a-41f7-a8f7-1cede431e234 already deleted. [ 587.521567] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8249b716-833a-41f7-a8f7-1cede431e234" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.702742] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9eefdc80-04da-470c-a646-561ea7857b56 [ 587.703204] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.703364] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.703502] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.703635] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.704356] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.704356] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9eefdc80-04da-470c-a646-561ea7857b56 already deleted. [ 587.704356] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9eefdc80-04da-470c-a646-561ea7857b56" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.421619] env[66502]: INFO networking_nsxv3.common.synchronization [None req-86f65af6-e884-4002-8ecb-44c90445950d None None] Enqueued Resource ID: 27b832f9-13d6-4bf9-ba69-d99e4362f7d1 with Priority: HIGHEST for action port [ 589.422318] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 27b832f9-13d6-4bf9-ba69-d99e4362f7d1 with Priority: HIGHEST for action port [ 589.422645] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-27b832f9-13d6-4bf9-ba69-d99e4362f7d1 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.422793] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-27b832f9-13d6-4bf9-ba69-d99e4362f7d1" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.422852] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-27b832f9-13d6-4bf9-ba69-d99e4362f7d1" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.423112] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-27b832f9-13d6-4bf9-ba69-d99e4362f7d1" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.423226] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('27b832f9-13d6-4bf9-ba69-d99e4362f7d1',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.532959] env[66502]: INFO networking_nsxv3.common.synchronization [req-acf17e5f-a046-4e0d-b8da-5ba3af52652b req-1aa39cab-e34d-4e91-ac36-367ee2e47451 tempest-TenantUsagesTestJSON-1983695498 tempest-TenantUsagesTestJSON-1983695498-project-member] Enqueued Resource ID: 10c7f564-e48d-436c-95ae-202237b0b833 with Priority: HIGHEST for action security_group_members [ 589.532959] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10c7f564-e48d-436c-95ae-202237b0b833 with Priority: HIGHEST for action security_group_members [ 589.532959] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-10c7f564-e48d-436c-95ae-202237b0b833 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.532959] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10c7f564-e48d-436c-95ae-202237b0b833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.532959] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10c7f564-e48d-436c-95ae-202237b0b833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.534163] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10c7f564-e48d-436c-95ae-202237b0b833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.534248] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.534378] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.534430] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.534636] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.534733] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.535338] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10c7f564-e48d-436c-95ae-202237b0b833',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.925811] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 27b832f9-13d6-4bf9-ba69-d99e4362f7d1 [ 589.925964] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.926069] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.926112] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.926484] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.926484] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.926484] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:27b832f9-13d6-4bf9-ba69-d99e4362f7d1 already deleted. [ 589.926617] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-27b832f9-13d6-4bf9-ba69-d99e4362f7d1" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.037311] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.037526] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.037600] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.038651] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.039542] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.039542] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.039542] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.039542] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.039542] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.039542] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.039829] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10c7f564-e48d-436c-95ae-202237b0b833 already deleted. [ 590.039880] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10c7f564-e48d-436c-95ae-202237b0b833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.203138] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-670 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.203439] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.203745] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.203926] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.204345] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.204581] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.204893] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.204986] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.206045] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.206045] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 590.206045] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 590.206045] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 590.206045] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 590.206045] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 590.206045] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 590.206045] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 590.233141] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 590.233141] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 590.233141] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 590.233141] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.233141] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-37c6705e-9dfd-4250-9387-01374d89ab0f taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.233386] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-37c6705e-9dfd-4250-9387-01374d89ab0f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.233483] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-37c6705e-9dfd-4250-9387-01374d89ab0f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.233857] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-37c6705e-9dfd-4250-9387-01374d89ab0f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.234012] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37c6705e-9dfd-4250-9387-01374d89ab0f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.736943] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.737368] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.737368] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.737703] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.737754] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.737875] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port 37c6705e-9dfd-4250-9387-01374d89ab0f not found, creating... [ 590.738153] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.738307] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.738413] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.738620] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.738753] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.739122] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.739275] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.739386] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.739589] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.739748] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.739850] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: 37c6705e-9dfd-4250-9387-01374d89ab0f is going to be created. [ 590.763248] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.763461] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.763582] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.763853] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.764088] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.764307] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-37c6705e-9dfd-4250-9387-01374d89ab0f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.120180] env[66502]: INFO networking_nsxv3.common.synchronization [None req-dbf7143b-55e9-451d-823d-a47c04c880b9 None None] Enqueued Resource ID: 9e3ab492-6584-40ee-a430-15369975bab9 with Priority: HIGHEST for action port [ 591.120448] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e3ab492-6584-40ee-a430-15369975bab9 with Priority: HIGHEST for action port [ 591.121089] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-9e3ab492-6584-40ee-a430-15369975bab9 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.121223] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9e3ab492-6584-40ee-a430-15369975bab9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.121223] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9e3ab492-6584-40ee-a430-15369975bab9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.121523] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9e3ab492-6584-40ee-a430-15369975bab9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.121523] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9e3ab492-6584-40ee-a430-15369975bab9',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.540816] env[66502]: INFO networking_nsxv3.common.synchronization [req-acf17e5f-a046-4e0d-b8da-5ba3af52652b req-90766fed-e927-48a9-a5e6-8a4ecd257c22 service nova] Enqueued Resource ID: 10c7f564-e48d-436c-95ae-202237b0b833 with Priority: HIGHEST for action security_group_rules [ 591.541082] env[66502]: INFO networking_nsxv3.common.synchronization [req-acf17e5f-a046-4e0d-b8da-5ba3af52652b req-90766fed-e927-48a9-a5e6-8a4ecd257c22 service nova] Enqueued Resource ID: 10c7f564-e48d-436c-95ae-202237b0b833 with Priority: HIGHEST for action security_group_members [ 591.541232] env[66502]: INFO networking_nsxv3.common.synchronization [req-acf17e5f-a046-4e0d-b8da-5ba3af52652b req-90766fed-e927-48a9-a5e6-8a4ecd257c22 service nova] Enqueued Resource ID: 37c6705e-9dfd-4250-9387-01374d89ab0f with Priority: HIGHEST for action port [ 591.541807] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10c7f564-e48d-436c-95ae-202237b0b833 with Priority: HIGHEST for action security_group_rules [ 591.541884] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10c7f564-e48d-436c-95ae-202237b0b833 with Priority: HIGHEST for action security_group_members [ 591.542035] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37c6705e-9dfd-4250-9387-01374d89ab0f with Priority: HIGHEST for action port [ 591.542270] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-10c7f564-e48d-436c-95ae-202237b0b833 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.542379] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-10c7f564-e48d-436c-95ae-202237b0b833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.542419] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-10c7f564-e48d-436c-95ae-202237b0b833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.542898] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-10c7f564-e48d-436c-95ae-202237b0b833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.542898] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('10c7f564-e48d-436c-95ae-202237b0b833',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.545463] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-10c7f564-e48d-436c-95ae-202237b0b833 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.545463] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10c7f564-e48d-436c-95ae-202237b0b833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.545463] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10c7f564-e48d-436c-95ae-202237b0b833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.545463] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10c7f564-e48d-436c-95ae-202237b0b833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.545463] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.545463] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.545463] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.545463] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.545463] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.545463] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10c7f564-e48d-436c-95ae-202237b0b833',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.546021] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-37c6705e-9dfd-4250-9387-01374d89ab0f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.546021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-37c6705e-9dfd-4250-9387-01374d89ab0f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.546228] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-37c6705e-9dfd-4250-9387-01374d89ab0f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.546228] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-37c6705e-9dfd-4250-9387-01374d89ab0f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.546298] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37c6705e-9dfd-4250-9387-01374d89ab0f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.624648] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9e3ab492-6584-40ee-a430-15369975bab9 [ 591.624648] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.628028] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.628158] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.628426] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.628593] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.628630] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9e3ab492-6584-40ee-a430-15369975bab9 already deleted. [ 591.628753] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9e3ab492-6584-40ee-a430-15369975bab9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.882930] env[66502]: INFO networking_nsxv3.common.synchronization [req-c91dd592-cfcf-4a67-9779-6d68db9e3afe req-46dac6ac-b98e-4365-9a2a-232e449a0797 tempest-DeleteServersAdminTestJSON-418815838 tempest-DeleteServersAdminTestJSON-418815838-project-member] Enqueued Resource ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 with Priority: HIGHEST for action security_group_members [ 591.883595] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 with Priority: HIGHEST for action security_group_members [ 591.883904] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-67c97dc5-9d08-4219-aa00-0b83a223ae57 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.884073] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.884193] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.884469] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.884653] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.884760] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.884823] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.884994] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.885110] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.885184] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67c97dc5-9d08-4219-aa00-0b83a223ae57',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.048967] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-10c7f564-e48d-436c-95ae-202237b0b833 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.049135] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10c7f564-e48d-436c-95ae-202237b0b833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.061836] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 37c6705e-9dfd-4250-9387-01374d89ab0f with status ACTIVE [ 592.062142] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.062285] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.062355] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.062608] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.062693] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.062869] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.062967] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.063037] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.063194] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.063270] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.063451] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.063539] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.063708] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.063779] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.063825] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.063908] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 37c6705e-9dfd-4250-9387-01374d89ab0f is going to be updated. [ 592.065195] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('10c7f564-e48d-436c-95ae-202237b0b833',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.091389] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.091538] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.093038] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.093038] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.093038] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.093038] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-37c6705e-9dfd-4250-9387-01374d89ab0f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.388917] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.389106] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.389190] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.391861] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.391861] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.391861] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.391861] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.391861] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.391861] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.392113] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.392113] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 already deleted. [ 592.392113] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.452530] env[66502]: INFO networking_nsxv3.common.synchronization [None req-443ade0c-190a-4ef5-9d7f-5fc4e044ac99 None None] Enqueued Resource ID: b2f72166-9f07-4fe0-ba68-3a9a46712f9a with Priority: HIGHEST for action port [ 592.452530] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b2f72166-9f07-4fe0-ba68-3a9a46712f9a with Priority: HIGHEST for action port [ 592.452530] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-b2f72166-9f07-4fe0-ba68-3a9a46712f9a taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.452530] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b2f72166-9f07-4fe0-ba68-3a9a46712f9a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.452530] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b2f72166-9f07-4fe0-ba68-3a9a46712f9a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.452856] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b2f72166-9f07-4fe0-ba68-3a9a46712f9a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.453070] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b2f72166-9f07-4fe0-ba68-3a9a46712f9a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.567610] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('10c7f564-e48d-436c-95ae-202237b0b833',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.678523] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-670 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.678523] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.680499] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.680798] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.681089] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.681734] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.681878] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.682177] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.682328] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.682561] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 592.682727] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 592.682851] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 592.682956] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 592.683077] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 592.683178] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 592.683305] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 592.708940] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 592.708940] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 592.708940] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 592.708940] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.708940] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-45ed9fe5-9a27-4013-ac92-197bbade6639 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.710560] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-45ed9fe5-9a27-4013-ac92-197bbade6639" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.714163] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-45ed9fe5-9a27-4013-ac92-197bbade6639" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.714163] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-45ed9fe5-9a27-4013-ac92-197bbade6639" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.714163] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45ed9fe5-9a27-4013-ac92-197bbade6639',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.955942] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b2f72166-9f07-4fe0-ba68-3a9a46712f9a [ 592.956233] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.956233] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.956338] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.956745] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.956745] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.956745] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b2f72166-9f07-4fe0-ba68-3a9a46712f9a already deleted. [ 592.956745] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b2f72166-9f07-4fe0-ba68-3a9a46712f9a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.071982] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.072163] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.072237] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.072474] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.072571] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.072665] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10c7f564-e48d-436c-95ae-202237b0b833 is going to be created. [ 593.117046] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.117046] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.117046] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.117046] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.117468] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.128878] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10c7f564-e48d-436c-95ae-202237b0b833 in Status: UNINITIALIZED for 2s [ 593.215505] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.215760] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.215760] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.216055] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.216389] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.216389] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 45ed9fe5-9a27-4013-ac92-197bbade6639 not found, creating... [ 593.216602] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.216778] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.217059] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.217140] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.217232] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.217600] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.217932] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.217932] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.217932] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.218222] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.218222] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 45ed9fe5-9a27-4013-ac92-197bbade6639 is going to be created. [ 593.238327] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.238568] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.238682] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.238911] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.239137] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.239350] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-45ed9fe5-9a27-4013-ac92-197bbade6639" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.389262] env[66502]: INFO networking_nsxv3.common.synchronization [None req-59a28f11-0797-4feb-883e-d536a4da3c05 None None] Enqueued Resource ID: 3f268869-ca18-49f8-b6a9-0cdff4ad5f31 with Priority: HIGHEST for action port [ 593.389262] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f268869-ca18-49f8-b6a9-0cdff4ad5f31 with Priority: HIGHEST for action port [ 593.389262] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f268869-ca18-49f8-b6a9-0cdff4ad5f31 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.389262] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f268869-ca18-49f8-b6a9-0cdff4ad5f31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.390667] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f268869-ca18-49f8-b6a9-0cdff4ad5f31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.391141] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f268869-ca18-49f8-b6a9-0cdff4ad5f31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.391356] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f268869-ca18-49f8-b6a9-0cdff4ad5f31',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.424234] env[66502]: INFO networking_nsxv3.common.synchronization [None req-ece2edcb-6c77-486b-bc02-f86a81ffa851 tempest-VolumesAssistedSnapshotsTest-591155639 tempest-VolumesAssistedSnapshotsTest-591155639-project-member] Enqueued Resource ID: bb24e830-31ca-4b75-ba92-3835430fbf29 with Priority: HIGHEST for action security_group_rules [ 593.429614] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb24e830-31ca-4b75-ba92-3835430fbf29 with Priority: HIGHEST for action security_group_rules [ 593.429614] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb24e830-31ca-4b75-ba92-3835430fbf29 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.429614] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb24e830-31ca-4b75-ba92-3835430fbf29" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.429614] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb24e830-31ca-4b75-ba92-3835430fbf29" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.429614] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb24e830-31ca-4b75-ba92-3835430fbf29" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.429614] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb24e830-31ca-4b75-ba92-3835430fbf29',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.894758] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3f268869-ca18-49f8-b6a9-0cdff4ad5f31 [ 593.894995] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.895148] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.895221] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.895479] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.895582] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.895687] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3f268869-ca18-49f8-b6a9-0cdff4ad5f31 already deleted. [ 593.895774] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f268869-ca18-49f8-b6a9-0cdff4ad5f31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.952949] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.953427] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.953537] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.953867] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.954414] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.954589] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb24e830-31ca-4b75-ba92-3835430fbf29 already deleted. [ 593.954910] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb24e830-31ca-4b75-ba92-3835430fbf29" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.070944] env[66502]: INFO networking_nsxv3.common.synchronization [req-c91dd592-cfcf-4a67-9779-6d68db9e3afe req-c5ed467c-3c4f-4faa-b579-82dc53b23e95 service nova] Enqueued Resource ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 with Priority: HIGHEST for action security_group_rules [ 594.071353] env[66502]: INFO networking_nsxv3.common.synchronization [req-c91dd592-cfcf-4a67-9779-6d68db9e3afe req-c5ed467c-3c4f-4faa-b579-82dc53b23e95 service nova] Enqueued Resource ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 with Priority: HIGHEST for action security_group_members [ 594.071353] env[66502]: INFO networking_nsxv3.common.synchronization [req-c91dd592-cfcf-4a67-9779-6d68db9e3afe req-c5ed467c-3c4f-4faa-b579-82dc53b23e95 service nova] Enqueued Resource ID: 45ed9fe5-9a27-4013-ac92-197bbade6639 with Priority: HIGHEST for action port [ 594.071826] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 with Priority: HIGHEST for action security_group_rules [ 594.072033] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 with Priority: HIGHEST for action security_group_members [ 594.072082] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45ed9fe5-9a27-4013-ac92-197bbade6639 with Priority: HIGHEST for action port [ 594.072361] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-67c97dc5-9d08-4219-aa00-0b83a223ae57 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.072452] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.072541] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.072757] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.072917] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('67c97dc5-9d08-4219-aa00-0b83a223ae57',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.074522] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-67c97dc5-9d08-4219-aa00-0b83a223ae57 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.074522] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.074522] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.074522] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.074522] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.074522] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.074522] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.074522] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.074522] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.074835] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67c97dc5-9d08-4219-aa00-0b83a223ae57',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.075573] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-45ed9fe5-9a27-4013-ac92-197bbade6639 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.075573] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45ed9fe5-9a27-4013-ac92-197bbade6639" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.075722] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45ed9fe5-9a27-4013-ac92-197bbade6639" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.075795] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45ed9fe5-9a27-4013-ac92-197bbade6639" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.075824] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45ed9fe5-9a27-4013-ac92-197bbade6639',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.249383] env[66502]: INFO networking_nsxv3.common.synchronization [None req-8c40eb6d-75e9-46fa-96f9-271d8212662c tempest-VolumesAssistedSnapshotsTest-591155639 tempest-VolumesAssistedSnapshotsTest-591155639-project-member] Enqueued Resource ID: bb24e830-31ca-4b75-ba92-3835430fbf29 with Priority: HIGHEST for action security_group_rules [ 594.249383] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb24e830-31ca-4b75-ba92-3835430fbf29 with Priority: HIGHEST for action security_group_rules [ 594.249383] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb24e830-31ca-4b75-ba92-3835430fbf29 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.249383] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb24e830-31ca-4b75-ba92-3835430fbf29" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.249383] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb24e830-31ca-4b75-ba92-3835430fbf29" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.249574] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb24e830-31ca-4b75-ba92-3835430fbf29" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.249574] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb24e830-31ca-4b75-ba92-3835430fbf29',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.501979] env[66502]: INFO networking_nsxv3.common.synchronization [req-de8a1cb5-b356-4050-ada3-13155f561163 req-001502f5-b1fc-4dcc-bc26-3909f41c8c35 tempest-ServerDiagnosticsTest-2078655975 tempest-ServerDiagnosticsTest-2078655975-project-member] Enqueued Resource ID: 6215e376-fd44-487b-9cf4-9b65dd953e4e with Priority: HIGHEST for action security_group_members [ 594.503915] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6215e376-fd44-487b-9cf4-9b65dd953e4e with Priority: HIGHEST for action security_group_members [ 594.503915] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6215e376-fd44-487b-9cf4-9b65dd953e4e taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.503915] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6215e376-fd44-487b-9cf4-9b65dd953e4e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.503915] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6215e376-fd44-487b-9cf4-9b65dd953e4e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.503915] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6215e376-fd44-487b-9cf4-9b65dd953e4e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.503915] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.503915] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.503915] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.503915] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.503915] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.503915] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6215e376-fd44-487b-9cf4-9b65dd953e4e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.581499] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-67c97dc5-9d08-4219-aa00-0b83a223ae57 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.581673] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.582036] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('67c97dc5-9d08-4219-aa00-0b83a223ae57',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.582706] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 45ed9fe5-9a27-4013-ac92-197bbade6639 with status ACTIVE [ 594.583668] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.583668] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.583668] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.583668] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.583668] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.583668] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.583668] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.583668] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.584051] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.584051] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.584051] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.584162] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.584195] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.584421] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.584421] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.584524] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 45ed9fe5-9a27-4013-ac92-197bbade6639 is going to be updated. [ 594.611202] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.611202] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.611202] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.611202] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.611202] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.611202] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45ed9fe5-9a27-4013-ac92-197bbade6639" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.800290] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.800884] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.800884] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.801252] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.801252] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.801252] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb24e830-31ca-4b75-ba92-3835430fbf29 already deleted. [ 594.801252] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb24e830-31ca-4b75-ba92-3835430fbf29" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.822011] env[66502]: INFO networking_nsxv3.common.synchronization [None req-63d400d0-fa09-4f97-99b6-e7265123b241 None None] Enqueued Resource ID: 6505d9ed-662e-4726-a4c9-5abd55109ac8 with Priority: HIGHEST for action port [ 594.823178] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6505d9ed-662e-4726-a4c9-5abd55109ac8 with Priority: HIGHEST for action port [ 594.823773] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-6505d9ed-662e-4726-a4c9-5abd55109ac8 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.823773] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6505d9ed-662e-4726-a4c9-5abd55109ac8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.823773] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6505d9ed-662e-4726-a4c9-5abd55109ac8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.825820] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6505d9ed-662e-4726-a4c9-5abd55109ac8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.826045] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6505d9ed-662e-4726-a4c9-5abd55109ac8',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.957496] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-670 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.957690] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.957857] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.958054] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.958346] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.958491] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.959530] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.959976] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.960146] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.960351] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 594.960633] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 594.960633] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 594.960795] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 594.961114] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 594.961395] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 594.961549] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 594.984788] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 594.984950] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 594.985082] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 594.985244] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.985553] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-77707475-ef8d-4437-b1bb-8eb09bb209d8 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.985715] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-77707475-ef8d-4437-b1bb-8eb09bb209d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.985826] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-77707475-ef8d-4437-b1bb-8eb09bb209d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.986185] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-77707475-ef8d-4437-b1bb-8eb09bb209d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.986302] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77707475-ef8d-4437-b1bb-8eb09bb209d8',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.005578] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.005812] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.005894] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.006123] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.006218] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.006420] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.006517] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.006574] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.007191] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.007191] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.007191] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6215e376-fd44-487b-9cf4-9b65dd953e4e already deleted. [ 595.007191] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6215e376-fd44-487b-9cf4-9b65dd953e4e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.089397] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('67c97dc5-9d08-4219-aa00-0b83a223ae57',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.139029] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10c7f564-e48d-436c-95ae-202237b0b833 in Status: SUCCESS [ 595.139029] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10c7f564-e48d-436c-95ae-202237b0b833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.139029] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10c7f564-e48d-436c-95ae-202237b0b833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.139394] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10c7f564-e48d-436c-95ae-202237b0b833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.139633] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.139956] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.139956] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.140076] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.140162] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.140251] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10c7f564-e48d-436c-95ae-202237b0b833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.140342] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('10c7f564-e48d-436c-95ae-202237b0b833',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.202884] env[66502]: INFO networking_nsxv3.common.synchronization [None req-210185a6-c38b-4526-9672-3ecb01c41a98 None None] Enqueued Resource ID: 81056e8c-ac50-4529-8669-3fad0de4cacf with Priority: HIGHEST for action port [ 595.202884] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81056e8c-ac50-4529-8669-3fad0de4cacf with Priority: HIGHEST for action port [ 595.202884] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-81056e8c-ac50-4529-8669-3fad0de4cacf taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.202884] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81056e8c-ac50-4529-8669-3fad0de4cacf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.202884] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81056e8c-ac50-4529-8669-3fad0de4cacf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.202884] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81056e8c-ac50-4529-8669-3fad0de4cacf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.202884] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81056e8c-ac50-4529-8669-3fad0de4cacf',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.328876] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6505d9ed-662e-4726-a4c9-5abd55109ac8 [ 595.329513] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.329513] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.329513] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.330046] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.330046] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.330046] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6505d9ed-662e-4726-a4c9-5abd55109ac8 already deleted. [ 595.330046] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6505d9ed-662e-4726-a4c9-5abd55109ac8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.489044] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.489613] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.489613] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.490180] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.490344] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.490804] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port 77707475-ef8d-4437-b1bb-8eb09bb209d8 not found, creating... [ 595.490950] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.491233] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.491394] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.492215] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.492215] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.492575] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.493527] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.493527] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.493527] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.493527] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.493644] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: 77707475-ef8d-4437-b1bb-8eb09bb209d8 is going to be created. [ 595.523201] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.523517] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.523565] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.523798] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.524993] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.524993] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-77707475-ef8d-4437-b1bb-8eb09bb209d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.591825] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.592566] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.592669] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.593639] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.593639] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.593639] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 is going to be created. [ 595.634514] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.634514] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.634514] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.634891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.635099] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.643032] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-10c7f564-e48d-436c-95ae-202237b0b833 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.643251] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10c7f564-e48d-436c-95ae-202237b0b833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.643251] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10c7f564-e48d-436c-95ae-202237b0b833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.644754] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10c7f564-e48d-436c-95ae-202237b0b833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.644754] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.644754] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.644754] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.644754] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.644754] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.644754] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10c7f564-e48d-436c-95ae-202237b0b833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.644754] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-10c7f564-e48d-436c-95ae-202237b0b833 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.644754] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10c7f564-e48d-436c-95ae-202237b0b833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.644754] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10c7f564-e48d-436c-95ae-202237b0b833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.644754] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10c7f564-e48d-436c-95ae-202237b0b833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.644754] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.644754] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.644754] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.645443] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.645443] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.645443] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10c7f564-e48d-436c-95ae-202237b0b833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.645443] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('10c7f564-e48d-436c-95ae-202237b0b833',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.646833] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 in Status: UNINITIALIZED for 2s [ 595.705211] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 81056e8c-ac50-4529-8669-3fad0de4cacf [ 595.705211] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.705211] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.705211] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.705211] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.705211] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.705211] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:81056e8c-ac50-4529-8669-3fad0de4cacf already deleted. [ 595.705211] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81056e8c-ac50-4529-8669-3fad0de4cacf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.106740] env[66502]: INFO networking_nsxv3.common.synchronization [req-dab57344-f3a0-47e3-8c47-2d09e85e4740 req-f5e49994-3733-4d30-82fc-2dceba110b67 tempest-ImagesTestJSON-1088460097 tempest-ImagesTestJSON-1088460097-project-member] Enqueued Resource ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 with Priority: HIGHEST for action security_group_members [ 596.107027] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 with Priority: HIGHEST for action security_group_members [ 596.107731] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.107731] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.107731] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.108601] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.108601] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.108601] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.108601] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.108601] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.108601] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.108976] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.148312] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 10c7f564-e48d-436c-95ae-202237b0b833: rpc.has_security_group_logging(os_id): False [ 596.168307] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.168307] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.168307] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.168307] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.168307] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.168307] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.168307] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.168307] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.168307] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.168666] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.168666] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.168666] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.168796] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.168917] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.169040] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.169704] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.169704] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.169704] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.169704] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.169704] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.169704] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 10c7f564-e48d-436c-95ae-202237b0b833 is going to be created. [ 596.223782] env[66502]: INFO networking_nsxv3.common.synchronization [req-de8a1cb5-b356-4050-ada3-13155f561163 req-43c11735-9a1e-4eca-b7d3-1ce16f7591e4 service nova] Enqueued Resource ID: 6215e376-fd44-487b-9cf4-9b65dd953e4e with Priority: HIGHEST for action security_group_rules [ 596.223974] env[66502]: INFO networking_nsxv3.common.synchronization [req-de8a1cb5-b356-4050-ada3-13155f561163 req-43c11735-9a1e-4eca-b7d3-1ce16f7591e4 service nova] Enqueued Resource ID: 6215e376-fd44-487b-9cf4-9b65dd953e4e with Priority: HIGHEST for action security_group_members [ 596.224148] env[66502]: INFO networking_nsxv3.common.synchronization [req-de8a1cb5-b356-4050-ada3-13155f561163 req-43c11735-9a1e-4eca-b7d3-1ce16f7591e4 service nova] Enqueued Resource ID: 77707475-ef8d-4437-b1bb-8eb09bb209d8 with Priority: HIGHEST for action port [ 596.224760] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6215e376-fd44-487b-9cf4-9b65dd953e4e with Priority: HIGHEST for action security_group_rules [ 596.224907] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6215e376-fd44-487b-9cf4-9b65dd953e4e with Priority: HIGHEST for action security_group_members [ 596.225032] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 77707475-ef8d-4437-b1bb-8eb09bb209d8 with Priority: HIGHEST for action port [ 596.225329] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6215e376-fd44-487b-9cf4-9b65dd953e4e taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.225475] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6215e376-fd44-487b-9cf4-9b65dd953e4e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.225579] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6215e376-fd44-487b-9cf4-9b65dd953e4e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.225846] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6215e376-fd44-487b-9cf4-9b65dd953e4e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.225942] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6215e376-fd44-487b-9cf4-9b65dd953e4e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.227408] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6215e376-fd44-487b-9cf4-9b65dd953e4e taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.227408] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6215e376-fd44-487b-9cf4-9b65dd953e4e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.227408] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6215e376-fd44-487b-9cf4-9b65dd953e4e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.227623] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6215e376-fd44-487b-9cf4-9b65dd953e4e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.227802] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.227878] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.227878] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.228061] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.228238] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.228379] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6215e376-fd44-487b-9cf4-9b65dd953e4e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.229163] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-77707475-ef8d-4437-b1bb-8eb09bb209d8 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.229272] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-77707475-ef8d-4437-b1bb-8eb09bb209d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.229360] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-77707475-ef8d-4437-b1bb-8eb09bb209d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.229781] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-77707475-ef8d-4437-b1bb-8eb09bb209d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.229781] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('77707475-ef8d-4437-b1bb-8eb09bb209d8',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.231871] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.231871] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.231871] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.231871] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.231871] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.248664] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 10c7f564-e48d-436c-95ae-202237b0b833 in Status: IN_PROGRESS for 2s [ 596.602442] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-545 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.602697] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-545" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.602878] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-545" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.603312] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-545" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.603694] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.603913] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.604095] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.604395] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.604618] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.604914] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 596.605071] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 596.605246] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 596.605422] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 596.605993] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 596.605993] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 596.605993] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 596.610797] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.611097] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.611180] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.611384] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.611857] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.611857] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.611857] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.611993] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.612183] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.612290] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.612410] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 already deleted. [ 596.612795] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.627941] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 596.628154] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 596.628255] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 596.628457] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-545" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.628905] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-2d247c27-838e-4358-88f4-6f210177fa64 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.629155] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-2d247c27-838e-4358-88f4-6f210177fa64" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.629298] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-2d247c27-838e-4358-88f4-6f210177fa64" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.629648] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-2d247c27-838e-4358-88f4-6f210177fa64" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.629798] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d247c27-838e-4358-88f4-6f210177fa64',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.730704] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6215e376-fd44-487b-9cf4-9b65dd953e4e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.735168] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6215e376-fd44-487b-9cf4-9b65dd953e4e taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.735168] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6215e376-fd44-487b-9cf4-9b65dd953e4e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.735168] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 77707475-ef8d-4437-b1bb-8eb09bb209d8 with status ACTIVE [ 596.735168] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.735408] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.735408] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.735705] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.735924] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.736247] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.736375] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.736442] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.736732] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.737176] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.737335] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.737335] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.737466] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.737693] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.737693] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.737809] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 77707475-ef8d-4437-b1bb-8eb09bb209d8 is going to be updated. [ 596.763052] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.763288] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.763288] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.763493] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.763640] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.763788] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-77707475-ef8d-4437-b1bb-8eb09bb209d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.132807] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.133273] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.133273] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.133447] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.133585] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.133732] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port 2d247c27-838e-4358-88f4-6f210177fa64 not found, creating... [ 597.134326] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.134455] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.134629] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.134791] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.135018] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.135243] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.135402] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.135527] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.135829] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.135972] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.136131] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: 2d247c27-838e-4358-88f4-6f210177fa64 is going to be created. [ 597.161327] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.161559] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.161676] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.161949] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.162266] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.162428] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-2d247c27-838e-4358-88f4-6f210177fa64" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.233675] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6215e376-fd44-487b-9cf4-9b65dd953e4e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.611451] env[66502]: INFO networking_nsxv3.common.synchronization [None req-1bed9f14-40c7-4e4b-8b4f-ad553c4945a4 None None] Enqueued Resource ID: b8ff9991-4e3d-4f49-be4b-fb97430fa0fa with Priority: HIGHEST for action port [ 597.612029] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8ff9991-4e3d-4f49-be4b-fb97430fa0fa with Priority: HIGHEST for action port [ 597.612248] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8ff9991-4e3d-4f49-be4b-fb97430fa0fa taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.612370] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8ff9991-4e3d-4f49-be4b-fb97430fa0fa" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.612457] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8ff9991-4e3d-4f49-be4b-fb97430fa0fa" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.612786] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8ff9991-4e3d-4f49-be4b-fb97430fa0fa" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.612865] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8ff9991-4e3d-4f49-be4b-fb97430fa0fa',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.660052] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 in Status: SUCCESS [ 597.660277] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.660459] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.660688] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.660908] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.661051] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.661148] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.661338] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.661434] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.661556] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.661659] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('67c97dc5-9d08-4219-aa00-0b83a223ae57',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.739216] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.739357] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.739431] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.739670] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.739760] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.739860] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6215e376-fd44-487b-9cf4-9b65dd953e4e is going to be created. [ 597.763319] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.763471] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.763537] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.763761] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.763912] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.773247] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6215e376-fd44-487b-9cf4-9b65dd953e4e in Status: UNINITIALIZED for 2s [ 597.862011] env[66502]: INFO networking_nsxv3.common.synchronization [req-dab57344-f3a0-47e3-8c47-2d09e85e4740 req-4ebd10d7-2d0f-4db6-b5fa-7ac804c8f068 service nova] Enqueued Resource ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 with Priority: HIGHEST for action security_group_rules [ 597.862195] env[66502]: INFO networking_nsxv3.common.synchronization [req-dab57344-f3a0-47e3-8c47-2d09e85e4740 req-4ebd10d7-2d0f-4db6-b5fa-7ac804c8f068 service nova] Enqueued Resource ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 with Priority: HIGHEST for action security_group_members [ 597.862340] env[66502]: INFO networking_nsxv3.common.synchronization [req-dab57344-f3a0-47e3-8c47-2d09e85e4740 req-4ebd10d7-2d0f-4db6-b5fa-7ac804c8f068 service nova] Enqueued Resource ID: 2d247c27-838e-4358-88f4-6f210177fa64 with Priority: HIGHEST for action port [ 597.863017] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 with Priority: HIGHEST for action security_group_rules [ 597.863411] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 with Priority: HIGHEST for action security_group_members [ 597.863411] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2d247c27-838e-4358-88f4-6f210177fa64 with Priority: HIGHEST for action port [ 597.863513] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.863642] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.863708] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.863972] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.864070] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.864991] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.865107] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.865179] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.865357] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.865505] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.865638] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.865638] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.865787] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.865876] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.865969] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.867071] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-2d247c27-838e-4358-88f4-6f210177fa64 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.867179] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2d247c27-838e-4358-88f4-6f210177fa64" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.867244] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2d247c27-838e-4358-88f4-6f210177fa64" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.867399] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2d247c27-838e-4358-88f4-6f210177fa64" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.867470] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2d247c27-838e-4358-88f4-6f210177fa64',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.115629] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b8ff9991-4e3d-4f49-be4b-fb97430fa0fa [ 598.115928] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.116179] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.116179] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.118291] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.118291] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.118291] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b8ff9991-4e3d-4f49-be4b-fb97430fa0fa already deleted. [ 598.118291] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8ff9991-4e3d-4f49-be4b-fb97430fa0fa" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.167731] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-67c97dc5-9d08-4219-aa00-0b83a223ae57 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.167956] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.167956] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.168176] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.168356] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.168469] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.168532] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.168698] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.168775] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.168861] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.169016] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-67c97dc5-9d08-4219-aa00-0b83a223ae57 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.169128] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.169208] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.170761] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.170761] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.170761] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.170761] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.170761] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.170761] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.170761] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.170761] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('67c97dc5-9d08-4219-aa00-0b83a223ae57',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.262167] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 10c7f564-e48d-436c-95ae-202237b0b833 in Status: SUCCESS [ 598.262495] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-10c7f564-e48d-436c-95ae-202237b0b833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.275344] env[66502]: INFO networking_nsxv3.common.synchronization [req-404a2c9f-4345-489b-8c37-f88da9be54bc req-589392e6-8a16-4bbf-988e-7149f3c2db49 tempest-ListServersNegativeTestJSON-658181297 tempest-ListServersNegativeTestJSON-658181297-project-member] Enqueued Resource ID: d777850f-4bcd-420d-ab88-295134770a5c with Priority: HIGHEST for action security_group_members [ 598.275767] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d777850f-4bcd-420d-ab88-295134770a5c with Priority: HIGHEST for action security_group_members [ 598.276131] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-d777850f-4bcd-420d-ab88-295134770a5c taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.276278] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.276390] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.276847] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.276847] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.276953] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.276986] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.277153] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.277233] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.277325] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d777850f-4bcd-420d-ab88-295134770a5c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.369985] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.369985] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.369985] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.370590] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2d247c27-838e-4358-88f4-6f210177fa64 with status ACTIVE [ 598.371198] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.371198] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.371198] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.371373] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.371465] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.371650] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.372230] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.372230] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.372230] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.374845] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.375222] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.375356] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.375882] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.376527] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.376680] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.377913] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2d247c27-838e-4358-88f4-6f210177fa64 is going to be updated. [ 598.403072] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.403190] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.403453] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.403512] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.404111] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.404111] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2d247c27-838e-4358-88f4-6f210177fa64" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.664402] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-226 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.664651] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-226" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.664832] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-226" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.665164] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-226" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.665454] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.665649] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.665774] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.666106] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.670332] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.670663] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 598.670742] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 598.670790] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 598.671075] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 598.671075] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 598.671141] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 598.671288] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 598.675741] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 67c97dc5-9d08-4219-aa00-0b83a223ae57: rpc.has_security_group_logging(os_id): False [ 598.696037] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 598.696520] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 598.696520] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 598.696520] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-226" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.696679] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-04dab892-2dba-4d00-817f-310eb5050206 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.696881] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-04dab892-2dba-4d00-817f-310eb5050206" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.699113] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-04dab892-2dba-4d00-817f-310eb5050206" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.702691] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-04dab892-2dba-4d00-817f-310eb5050206" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.702691] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04dab892-2dba-4d00-817f-310eb5050206',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.712034] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.712034] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.712034] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.712034] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.712034] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.712034] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.712034] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.712034] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.712034] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.712034] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.712034] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.712034] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.712034] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.712034] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.712034] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.714032] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.714032] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.714032] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.714032] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.714032] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.714032] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 is going to be created. [ 598.779590] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.779748] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.779820] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.780069] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.780161] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.780385] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.780485] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.780546] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.780729] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.780885] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.780885] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d777850f-4bcd-420d-ab88-295134770a5c already deleted. [ 598.780979] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.817636] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.817823] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.817968] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.818199] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.818408] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.842975] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 in Status: IN_PROGRESS for 2s [ 598.880575] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.205968] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.206287] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.206488] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.206733] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.206974] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.207223] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port 04dab892-2dba-4d00-817f-310eb5050206 not found, creating... [ 599.207511] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.207670] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.207783] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.208018] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.208161] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.208429] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.208594] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.208686] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.208907] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.209044] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.209177] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: 04dab892-2dba-4d00-817f-310eb5050206 is going to be created. [ 599.234696] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.234992] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.235103] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.235380] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.235602] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.235917] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-04dab892-2dba-4d00-817f-310eb5050206" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.382950] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.383145] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.383145] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.384244] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.384244] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.384244] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 is going to be created. [ 599.423764] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.423904] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.423981] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.424200] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.424359] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.435951] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 in Status: UNINITIALIZED for 2s [ 599.787047] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6215e376-fd44-487b-9cf4-9b65dd953e4e in Status: SUCCESS [ 599.787367] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6215e376-fd44-487b-9cf4-9b65dd953e4e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.787423] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6215e376-fd44-487b-9cf4-9b65dd953e4e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.787742] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6215e376-fd44-487b-9cf4-9b65dd953e4e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.787819] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.788161] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.788161] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.788161] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.788296] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.788296] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6215e376-fd44-487b-9cf4-9b65dd953e4e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.788762] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6215e376-fd44-487b-9cf4-9b65dd953e4e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.934935] env[66502]: INFO networking_nsxv3.common.synchronization [req-404a2c9f-4345-489b-8c37-f88da9be54bc req-85351715-93f5-48a1-9061-a47d73ac2c2d service nova] Enqueued Resource ID: d777850f-4bcd-420d-ab88-295134770a5c with Priority: HIGHEST for action security_group_rules [ 599.935139] env[66502]: INFO networking_nsxv3.common.synchronization [req-404a2c9f-4345-489b-8c37-f88da9be54bc req-85351715-93f5-48a1-9061-a47d73ac2c2d service nova] Enqueued Resource ID: d777850f-4bcd-420d-ab88-295134770a5c with Priority: HIGHEST for action security_group_members [ 599.935274] env[66502]: INFO networking_nsxv3.common.synchronization [req-404a2c9f-4345-489b-8c37-f88da9be54bc req-85351715-93f5-48a1-9061-a47d73ac2c2d service nova] Enqueued Resource ID: 04dab892-2dba-4d00-817f-310eb5050206 with Priority: HIGHEST for action port [ 599.937953] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d777850f-4bcd-420d-ab88-295134770a5c with Priority: HIGHEST for action security_group_rules [ 599.937953] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d777850f-4bcd-420d-ab88-295134770a5c with Priority: HIGHEST for action security_group_members [ 599.937953] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04dab892-2dba-4d00-817f-310eb5050206 with Priority: HIGHEST for action port [ 599.937953] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d777850f-4bcd-420d-ab88-295134770a5c taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.937953] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.937953] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.937953] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.937953] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d777850f-4bcd-420d-ab88-295134770a5c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.937953] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-d777850f-4bcd-420d-ab88-295134770a5c taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.937953] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.937953] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.937953] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.938350] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.938350] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.938350] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.938446] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.938478] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.938976] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d777850f-4bcd-420d-ab88-295134770a5c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.939280] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-04dab892-2dba-4d00-817f-310eb5050206 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.939377] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04dab892-2dba-4d00-817f-310eb5050206" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.939438] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04dab892-2dba-4d00-817f-310eb5050206" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.939600] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04dab892-2dba-4d00-817f-310eb5050206" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.941135] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04dab892-2dba-4d00-817f-310eb5050206',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.001220] env[66502]: INFO networking_nsxv3.common.synchronization [None req-b6f8f6be-dc15-4f05-a749-2fade2395a4c None None] Enqueued Resource ID: 23f5584c-9ad4-41c3-8fcb-2002422fa6e4 with Priority: HIGHEST for action port [ 600.001630] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23f5584c-9ad4-41c3-8fcb-2002422fa6e4 with Priority: HIGHEST for action port [ 600.001936] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-23f5584c-9ad4-41c3-8fcb-2002422fa6e4 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.002116] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-23f5584c-9ad4-41c3-8fcb-2002422fa6e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.002189] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-23f5584c-9ad4-41c3-8fcb-2002422fa6e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.002422] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-23f5584c-9ad4-41c3-8fcb-2002422fa6e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.002485] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('23f5584c-9ad4-41c3-8fcb-2002422fa6e4',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.291586] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6215e376-fd44-487b-9cf4-9b65dd953e4e taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.291938] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6215e376-fd44-487b-9cf4-9b65dd953e4e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.291938] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6215e376-fd44-487b-9cf4-9b65dd953e4e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.292125] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6215e376-fd44-487b-9cf4-9b65dd953e4e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.292305] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.292401] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.292471] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.292635] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.292730] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.292836] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6215e376-fd44-487b-9cf4-9b65dd953e4e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.292991] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6215e376-fd44-487b-9cf4-9b65dd953e4e taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.293167] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6215e376-fd44-487b-9cf4-9b65dd953e4e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.293229] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6215e376-fd44-487b-9cf4-9b65dd953e4e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.293383] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6215e376-fd44-487b-9cf4-9b65dd953e4e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.293561] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.293663] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.293726] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.293871] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.293952] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.294538] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6215e376-fd44-487b-9cf4-9b65dd953e4e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.294795] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6215e376-fd44-487b-9cf4-9b65dd953e4e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.443452] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-d777850f-4bcd-420d-ab88-295134770a5c taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.443452] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.443587] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d777850f-4bcd-420d-ab88-295134770a5c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.444475] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 04dab892-2dba-4d00-817f-310eb5050206 with status ACTIVE [ 600.444685] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.444802] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.444861] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.445084] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.445173] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.445347] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.445458] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.445493] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.445696] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.445729] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.445907] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.446011] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.446675] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.446848] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.446932] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.447037] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 04dab892-2dba-4d00-817f-310eb5050206 is going to be updated. [ 600.471584] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.471841] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.471841] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.472013] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.472216] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.472374] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04dab892-2dba-4d00-817f-310eb5050206" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.504991] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 23f5584c-9ad4-41c3-8fcb-2002422fa6e4 [ 600.505346] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.505462] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.505462] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.505895] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.505895] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.505895] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:23f5584c-9ad4-41c3-8fcb-2002422fa6e4 already deleted. [ 600.505895] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-23f5584c-9ad4-41c3-8fcb-2002422fa6e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.531068] env[66502]: INFO networking_nsxv3.common.synchronization [req-404a2c9f-4345-489b-8c37-f88da9be54bc req-10f38a08-daab-4036-a720-50c434537778 tempest-ListServersNegativeTestJSON-658181297 tempest-ListServersNegativeTestJSON-658181297-project-member] Enqueued Resource ID: d777850f-4bcd-420d-ab88-295134770a5c with Priority: HIGHEST for action security_group_members [ 600.531768] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d777850f-4bcd-420d-ab88-295134770a5c with Priority: HIGHEST for action security_group_members [ 600.532139] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-d777850f-4bcd-420d-ab88-295134770a5c taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.532252] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.799661] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6215e376-fd44-487b-9cf4-9b65dd953e4e: rpc.has_security_group_logging(os_id): False [ 600.818977] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.818977] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.818977] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.818977] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.818977] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.818977] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.818977] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.819414] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.819414] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.819414] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.819524] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.819714] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.819714] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.819850] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.819881] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.820068] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.820162] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.820222] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.820360] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.820432] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.820542] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6215e376-fd44-487b-9cf4-9b65dd953e4e is going to be created. [ 600.857873] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 in Status: SUCCESS [ 600.858347] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.884859] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.885891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.886012] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.887558] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.887764] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.903694] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6215e376-fd44-487b-9cf4-9b65dd953e4e in Status: IN_PROGRESS for 2s [ 600.949288] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d777850f-4bcd-420d-ab88-295134770a5c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.959716] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-226 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.960269] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-226" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.960269] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-226" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.960485] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-226" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.961285] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.961285] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.961522] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.961637] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.961823] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.962076] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 600.962227] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 600.962356] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 600.963039] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 600.963217] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 600.963355] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 600.963492] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 600.992734] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 600.993412] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 600.993412] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 600.993596] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-226" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.993818] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-8796b4cf-21b6-45a8-aac5-10d5a14b42ba taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.993987] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-8796b4cf-21b6-45a8-aac5-10d5a14b42ba" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.994113] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-8796b4cf-21b6-45a8-aac5-10d5a14b42ba" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.994448] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-8796b4cf-21b6-45a8-aac5-10d5a14b42ba" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.994718] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8796b4cf-21b6-45a8-aac5-10d5a14b42ba',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.448159] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 in Status: SUCCESS [ 601.448497] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.448547] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.448882] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.449131] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.449530] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.449604] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.449893] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.450039] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.450194] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.450381] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.451759] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.451886] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.451984] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.452168] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.452250] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.452341] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d777850f-4bcd-420d-ab88-295134770a5c is going to be created. [ 601.482844] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.482844] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.482844] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.482844] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.482844] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.492209] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d777850f-4bcd-420d-ab88-295134770a5c in Status: UNINITIALIZED for 2s [ 601.500839] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.500839] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.500839] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.500839] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.500839] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.500839] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 8796b4cf-21b6-45a8-aac5-10d5a14b42ba not found, creating... [ 601.500839] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.500839] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.500839] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.500839] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.500839] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.501577] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.501577] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.501577] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.501577] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.501577] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.501577] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 8796b4cf-21b6-45a8-aac5-10d5a14b42ba is going to be created. [ 601.523138] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.523360] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.523477] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.523747] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.523963] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.524243] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-8796b4cf-21b6-45a8-aac5-10d5a14b42ba" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.956152] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.956152] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.956152] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.956594] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.957344] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.957344] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.957344] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.957572] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.957826] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.957966] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.958268] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.958416] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.958533] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.958738] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.959025] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.959098] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.959331] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.959364] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.959475] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.959648] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.959796] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.287292] env[66502]: INFO networking_nsxv3.common.synchronization [req-404a2c9f-4345-489b-8c37-f88da9be54bc req-4b129495-cf8a-447c-89cf-7cddf3265cb8 service nova] Enqueued Resource ID: d777850f-4bcd-420d-ab88-295134770a5c with Priority: HIGHEST for action security_group_rules [ 602.287292] env[66502]: INFO networking_nsxv3.common.synchronization [req-404a2c9f-4345-489b-8c37-f88da9be54bc req-4b129495-cf8a-447c-89cf-7cddf3265cb8 service nova] Enqueued Resource ID: d777850f-4bcd-420d-ab88-295134770a5c with Priority: HIGHEST for action security_group_members [ 602.287292] env[66502]: INFO networking_nsxv3.common.synchronization [req-404a2c9f-4345-489b-8c37-f88da9be54bc req-4b129495-cf8a-447c-89cf-7cddf3265cb8 service nova] Enqueued Resource ID: 8796b4cf-21b6-45a8-aac5-10d5a14b42ba with Priority: HIGHEST for action port [ 602.287292] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d777850f-4bcd-420d-ab88-295134770a5c with Priority: HIGHEST for action security_group_rules [ 602.287292] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d777850f-4bcd-420d-ab88-295134770a5c with Priority: HIGHEST for action security_group_members [ 602.287292] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8796b4cf-21b6-45a8-aac5-10d5a14b42ba with Priority: HIGHEST for action port [ 602.287292] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d777850f-4bcd-420d-ab88-295134770a5c taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.287292] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.287292] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-d777850f-4bcd-420d-ab88-295134770a5c taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.292847] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.292847] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-8796b4cf-21b6-45a8-aac5-10d5a14b42ba taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.292847] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8796b4cf-21b6-45a8-aac5-10d5a14b42ba" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.292847] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8796b4cf-21b6-45a8-aac5-10d5a14b42ba" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.292847] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8796b4cf-21b6-45a8-aac5-10d5a14b42ba" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.292847] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8796b4cf-21b6-45a8-aac5-10d5a14b42ba',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.463201] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2: rpc.has_security_group_logging(os_id): False [ 602.486926] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.487242] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.487336] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.487633] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.487789] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.488051] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.488101] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.488176] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.488337] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.488517] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.488747] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.488852] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.488918] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.491638] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.491774] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.492032] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.492190] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.492285] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.492487] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.492680] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.492818] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 is going to be created. [ 602.553564] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.553781] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.553781] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.554018] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.554211] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.566993] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 in Status: IN_PROGRESS for 2s [ 602.794355] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8796b4cf-21b6-45a8-aac5-10d5a14b42ba with status ACTIVE [ 602.795408] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.795864] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.795864] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.795864] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.795978] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.796328] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.796328] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.796328] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.796477] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.796533] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.796977] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.796977] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.796977] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.797112] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.797159] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.797534] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8796b4cf-21b6-45a8-aac5-10d5a14b42ba is going to be updated. [ 602.821627] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.821778] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.821898] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.822054] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.822220] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.822453] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8796b4cf-21b6-45a8-aac5-10d5a14b42ba" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.920017] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6215e376-fd44-487b-9cf4-9b65dd953e4e in Status: SUCCESS [ 602.920087] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6215e376-fd44-487b-9cf4-9b65dd953e4e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.148921] env[66502]: INFO networking_nsxv3.common.synchronization [req-404a2c9f-4345-489b-8c37-f88da9be54bc req-cd714849-be23-4fee-b556-534091ea63d5 tempest-ListServersNegativeTestJSON-658181297 tempest-ListServersNegativeTestJSON-658181297-project-member] Enqueued Resource ID: d777850f-4bcd-420d-ab88-295134770a5c with Priority: HIGHEST for action security_group_members [ 603.149473] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d777850f-4bcd-420d-ab88-295134770a5c with Priority: HIGHEST for action security_group_members [ 603.149765] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-d777850f-4bcd-420d-ab88-295134770a5c taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.150129] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.504427] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d777850f-4bcd-420d-ab88-295134770a5c in Status: SUCCESS [ 603.504427] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.504427] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.504427] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.504427] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.504427] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.504427] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.504427] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.504427] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.504427] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.504427] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d777850f-4bcd-420d-ab88-295134770a5c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.505327] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.505327] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.505327] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.505327] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.505327] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.505327] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.506725] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.506725] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d777850f-4bcd-420d-ab88-295134770a5c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.770026] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-226 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.770197] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-226" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.770314] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-226" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.770580] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-226" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.770840] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.771070] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.771136] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.771743] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.771743] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.771743] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 603.771886] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 603.771916] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 603.772025] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 603.772605] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 603.772605] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 603.772605] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 603.794345] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 603.794465] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 603.794646] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 603.794812] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-226" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.795111] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-48ea0939-455c-4011-9a4c-2b3cbde40a5b taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.795278] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-48ea0939-455c-4011-9a4c-2b3cbde40a5b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.795432] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-48ea0939-455c-4011-9a4c-2b3cbde40a5b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.795713] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-48ea0939-455c-4011-9a4c-2b3cbde40a5b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.795845] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48ea0939-455c-4011-9a4c-2b3cbde40a5b',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.007459] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-d777850f-4bcd-420d-ab88-295134770a5c taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.007743] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.007984] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d777850f-4bcd-420d-ab88-295134770a5c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.026647] env[66502]: INFO networking_nsxv3.common.synchronization [None req-d49deb1f-944d-4640-b4d4-23e97ef27f04 None None] Enqueued Resource ID: c83b9e82-5faf-4c64-8335-e8cc0531744f with Priority: HIGHEST for action port [ 604.027340] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c83b9e82-5faf-4c64-8335-e8cc0531744f with Priority: HIGHEST for action port [ 604.027756] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-c83b9e82-5faf-4c64-8335-e8cc0531744f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.028280] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c83b9e82-5faf-4c64-8335-e8cc0531744f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.028280] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c83b9e82-5faf-4c64-8335-e8cc0531744f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.028601] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c83b9e82-5faf-4c64-8335-e8cc0531744f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.028726] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c83b9e82-5faf-4c64-8335-e8cc0531744f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.299815] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.300363] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.300768] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.301210] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.301650] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.302127] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port 48ea0939-455c-4011-9a4c-2b3cbde40a5b not found, creating... [ 604.302633] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.303322] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.303698] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.304190] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.304487] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.304991] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.305354] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.305738] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.305994] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.306335] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.306927] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: 48ea0939-455c-4011-9a4c-2b3cbde40a5b is going to be created. [ 604.343203] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.343607] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.343822] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.344718] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.345221] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.345679] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-48ea0939-455c-4011-9a4c-2b3cbde40a5b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.510298] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d777850f-4bcd-420d-ab88-295134770a5c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.531590] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c83b9e82-5faf-4c64-8335-e8cc0531744f [ 604.532727] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.533047] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.533047] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.533361] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.533361] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.534173] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c83b9e82-5faf-4c64-8335-e8cc0531744f already deleted. [ 604.534173] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c83b9e82-5faf-4c64-8335-e8cc0531744f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.584123] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 in Status: SUCCESS [ 604.584310] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.015178] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.015404] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.015475] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.015649] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.015852] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.015953] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d777850f-4bcd-420d-ab88-295134770a5c is going to be updated. [ 605.034201] env[66502]: INFO networking_nsxv3.common.synchronization [req-404a2c9f-4345-489b-8c37-f88da9be54bc req-bfcdec7d-6b5a-453a-ad6a-128f9f0d62cb service nova] Enqueued Resource ID: d777850f-4bcd-420d-ab88-295134770a5c with Priority: HIGHEST for action security_group_rules [ 605.034538] env[66502]: INFO networking_nsxv3.common.synchronization [req-404a2c9f-4345-489b-8c37-f88da9be54bc req-bfcdec7d-6b5a-453a-ad6a-128f9f0d62cb service nova] Enqueued Resource ID: d777850f-4bcd-420d-ab88-295134770a5c with Priority: HIGHEST for action security_group_members [ 605.034961] env[66502]: INFO networking_nsxv3.common.synchronization [req-404a2c9f-4345-489b-8c37-f88da9be54bc req-bfcdec7d-6b5a-453a-ad6a-128f9f0d62cb service nova] Enqueued Resource ID: 48ea0939-455c-4011-9a4c-2b3cbde40a5b with Priority: HIGHEST for action port [ 605.035807] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d777850f-4bcd-420d-ab88-295134770a5c with Priority: HIGHEST for action security_group_rules [ 605.035979] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d777850f-4bcd-420d-ab88-295134770a5c with Priority: HIGHEST for action security_group_members [ 605.036113] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 48ea0939-455c-4011-9a4c-2b3cbde40a5b with Priority: HIGHEST for action port [ 605.036507] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d777850f-4bcd-420d-ab88-295134770a5c taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.036657] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.036897] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-d777850f-4bcd-420d-ab88-295134770a5c taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.037079] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.037317] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-48ea0939-455c-4011-9a4c-2b3cbde40a5b taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.037388] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-48ea0939-455c-4011-9a4c-2b3cbde40a5b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.037495] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-48ea0939-455c-4011-9a4c-2b3cbde40a5b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.037728] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-48ea0939-455c-4011-9a4c-2b3cbde40a5b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.038037] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('48ea0939-455c-4011-9a4c-2b3cbde40a5b',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.053131] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.053336] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.053336] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.053540] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.053675] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.063988] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d777850f-4bcd-420d-ab88-295134770a5c in Status: IN_PROGRESS for 2s [ 605.507762] env[66502]: INFO networking_nsxv3.common.synchronization [req-98993bf1-9174-483f-8b9b-0c54e1ae61a8 req-b12c8ec3-96c6-417c-a31e-144a8c455ef9 tempest-MultipleCreateTestJSON-1551479830 tempest-MultipleCreateTestJSON-1551479830-project-member] Enqueued Resource ID: 75e42630-d365-4bb0-89c0-55b0baee0268 with Priority: HIGHEST for action security_group_members [ 605.511013] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75e42630-d365-4bb0-89c0-55b0baee0268 with Priority: HIGHEST for action security_group_members [ 605.511013] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e42630-d365-4bb0-89c0-55b0baee0268 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.511013] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.511013] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.511013] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.511013] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.511013] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.511013] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.511013] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.511013] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.511013] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75e42630-d365-4bb0-89c0-55b0baee0268',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.540886] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 48ea0939-455c-4011-9a4c-2b3cbde40a5b with status ACTIVE [ 605.540886] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.540886] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.540886] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.540886] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.540886] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.540886] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.540886] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.541284] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.541284] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.541284] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.541384] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.541433] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.541514] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.541671] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.541671] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.541761] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 48ea0939-455c-4011-9a4c-2b3cbde40a5b is going to be updated. [ 605.565988] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.566196] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.566273] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.566484] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.566617] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.566784] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-48ea0939-455c-4011-9a4c-2b3cbde40a5b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.950961] env[66502]: INFO networking_nsxv3.common.synchronization [None req-1ebf536d-215f-4a01-8d63-58ef8475b420 None None] Enqueued Resource ID: cd2da39f-c0e6-48ee-bf52-88a4eedcd650 with Priority: HIGHEST for action port [ 605.951577] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd2da39f-c0e6-48ee-bf52-88a4eedcd650 with Priority: HIGHEST for action port [ 605.951919] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd2da39f-c0e6-48ee-bf52-88a4eedcd650 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.955869] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd2da39f-c0e6-48ee-bf52-88a4eedcd650" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.955993] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd2da39f-c0e6-48ee-bf52-88a4eedcd650" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.956353] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd2da39f-c0e6-48ee-bf52-88a4eedcd650" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.956450] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd2da39f-c0e6-48ee-bf52-88a4eedcd650',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.013937] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.014359] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.014488] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.014787] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.014923] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.015381] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.015381] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.015381] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.015564] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.015564] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.015739] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75e42630-d365-4bb0-89c0-55b0baee0268 already deleted. [ 606.015739] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.175407] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-458 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.175596] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-458" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.175746] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-458" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.176099] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-458" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.176367] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.176795] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.176950] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.177269] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.177350] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.177512] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 606.177685] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 606.177749] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 606.177818] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 606.177923] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 606.178617] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 606.178617] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 606.199776] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 606.199937] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 606.200093] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 606.200265] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-458" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.201689] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-4705e28e-585e-4a25-b5b3-254cb86a2d74 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.201689] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-4705e28e-585e-4a25-b5b3-254cb86a2d74" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.201689] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-4705e28e-585e-4a25-b5b3-254cb86a2d74" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.201689] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-4705e28e-585e-4a25-b5b3-254cb86a2d74" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.201689] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4705e28e-585e-4a25-b5b3-254cb86a2d74',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.463276] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cd2da39f-c0e6-48ee-bf52-88a4eedcd650 [ 606.463276] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.463276] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.463276] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.463276] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.463276] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.463276] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cd2da39f-c0e6-48ee-bf52-88a4eedcd650 already deleted. [ 606.463276] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd2da39f-c0e6-48ee-bf52-88a4eedcd650" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.491244] env[66502]: INFO networking_nsxv3.common.synchronization [None req-c2a4e5e9-e3b7-4885-ac69-8b27d61e57d0 None None] Enqueued Resource ID: 5afe03c1-7f70-4258-beba-ab0b5d977842 with Priority: HIGHEST for action port [ 606.491509] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5afe03c1-7f70-4258-beba-ab0b5d977842 with Priority: HIGHEST for action port [ 606.492099] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-5afe03c1-7f70-4258-beba-ab0b5d977842 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.492264] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5afe03c1-7f70-4258-beba-ab0b5d977842" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.492264] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5afe03c1-7f70-4258-beba-ab0b5d977842" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.492518] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5afe03c1-7f70-4258-beba-ab0b5d977842" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.492962] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5afe03c1-7f70-4258-beba-ab0b5d977842',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.705466] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.705945] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.705945] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.706133] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.706294] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.706428] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 4705e28e-585e-4a25-b5b3-254cb86a2d74 not found, creating... [ 606.706674] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.706870] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.707036] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.707156] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.707263] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.707970] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.707970] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.707970] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.708352] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.708352] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.708352] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 4705e28e-585e-4a25-b5b3-254cb86a2d74 is going to be created. [ 606.730931] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.731189] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.731402] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.731591] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.731808] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.732045] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-4705e28e-585e-4a25-b5b3-254cb86a2d74" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.999253] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5afe03c1-7f70-4258-beba-ab0b5d977842 [ 606.999494] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.999632] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.999700] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.999920] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.002497] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.002497] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5afe03c1-7f70-4258-beba-ab0b5d977842 already deleted. [ 607.002497] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5afe03c1-7f70-4258-beba-ab0b5d977842" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.077061] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d777850f-4bcd-420d-ab88-295134770a5c in Status: SUCCESS [ 607.077290] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.077457] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.078027] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.078027] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.078027] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.078247] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.078247] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.078314] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.078399] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d777850f-4bcd-420d-ab88-295134770a5c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.448892] env[66502]: INFO networking_nsxv3.common.synchronization [req-98993bf1-9174-483f-8b9b-0c54e1ae61a8 req-2ad18761-d2b9-484e-9e4b-6810c4764a23 service nova] Enqueued Resource ID: 75e42630-d365-4bb0-89c0-55b0baee0268 with Priority: HIGHEST for action security_group_rules [ 607.449140] env[66502]: INFO networking_nsxv3.common.synchronization [req-98993bf1-9174-483f-8b9b-0c54e1ae61a8 req-2ad18761-d2b9-484e-9e4b-6810c4764a23 service nova] Enqueued Resource ID: 75e42630-d365-4bb0-89c0-55b0baee0268 with Priority: HIGHEST for action security_group_members [ 607.449206] env[66502]: INFO networking_nsxv3.common.synchronization [req-98993bf1-9174-483f-8b9b-0c54e1ae61a8 req-2ad18761-d2b9-484e-9e4b-6810c4764a23 service nova] Enqueued Resource ID: 4705e28e-585e-4a25-b5b3-254cb86a2d74 with Priority: HIGHEST for action port [ 607.449418] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75e42630-d365-4bb0-89c0-55b0baee0268 with Priority: HIGHEST for action security_group_rules [ 607.449634] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75e42630-d365-4bb0-89c0-55b0baee0268 with Priority: HIGHEST for action security_group_members [ 607.449634] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4705e28e-585e-4a25-b5b3-254cb86a2d74 with Priority: HIGHEST for action port [ 607.450200] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75e42630-d365-4bb0-89c0-55b0baee0268 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.450496] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.450496] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.451475] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.451557] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75e42630-d365-4bb0-89c0-55b0baee0268',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.452960] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e42630-d365-4bb0-89c0-55b0baee0268 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.452960] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.452960] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.453500] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.453500] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.453692] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.453692] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.453981] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.453981] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.453981] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75e42630-d365-4bb0-89c0-55b0baee0268',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.455094] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-4705e28e-585e-4a25-b5b3-254cb86a2d74 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.455235] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4705e28e-585e-4a25-b5b3-254cb86a2d74" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.455524] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4705e28e-585e-4a25-b5b3-254cb86a2d74" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.455558] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4705e28e-585e-4a25-b5b3-254cb86a2d74" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.455679] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4705e28e-585e-4a25-b5b3-254cb86a2d74',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.580616] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d777850f-4bcd-420d-ab88-295134770a5c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.741592] env[66502]: INFO networking_nsxv3.common.synchronization [req-98993bf1-9174-483f-8b9b-0c54e1ae61a8 req-863590dc-ca42-4514-ae87-98670bc8a9ec tempest-MultipleCreateTestJSON-1551479830 tempest-MultipleCreateTestJSON-1551479830-project-member] Enqueued Resource ID: 75e42630-d365-4bb0-89c0-55b0baee0268 with Priority: HIGHEST for action security_group_members [ 607.742133] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75e42630-d365-4bb0-89c0-55b0baee0268 with Priority: HIGHEST for action security_group_members [ 607.742446] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e42630-d365-4bb0-89c0-55b0baee0268 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.742604] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.958875] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e42630-d365-4bb0-89c0-55b0baee0268 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.959084] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.959235] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75e42630-d365-4bb0-89c0-55b0baee0268',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.960202] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4705e28e-585e-4a25-b5b3-254cb86a2d74 with status ACTIVE [ 607.960302] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.960389] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.960426] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.960636] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.960688] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.960856] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.960954] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.961031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.961179] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.961259] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.961457] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.961534] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.961575] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.961722] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.961787] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.961865] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4705e28e-585e-4a25-b5b3-254cb86a2d74 is going to be updated. [ 607.984405] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.985280] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.985377] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.985608] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.985769] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.986434] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4705e28e-585e-4a25-b5b3-254cb86a2d74" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.062152] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-458 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.062439] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-458" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.062623] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-458" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.063020] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-458" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.063544] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.063702] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.063879] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.064238] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.064465] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.064858] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 608.064900] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 608.065018] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 608.065195] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 608.065387] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 608.065557] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 608.065727] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 608.084134] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d777850f-4bcd-420d-ab88-295134770a5c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.089465] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 608.089629] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 608.090112] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 608.090112] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-458" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.090296] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-03169133-27d3-46d9-90ce-df708ffba627 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.090461] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-03169133-27d3-46d9-90ce-df708ffba627" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.090570] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-03169133-27d3-46d9-90ce-df708ffba627" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.090897] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-03169133-27d3-46d9-90ce-df708ffba627" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.091042] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03169133-27d3-46d9-90ce-df708ffba627',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.464242] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75e42630-d365-4bb0-89c0-55b0baee0268',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.588492] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.588865] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.588865] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.589082] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.589208] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.589347] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d777850f-4bcd-420d-ab88-295134770a5c is going to be updated. [ 608.593777] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.594050] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.594234] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.594558] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.594747] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.594897] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 03169133-27d3-46d9-90ce-df708ffba627 not found, creating... [ 608.595226] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.595388] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.595499] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.595753] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.595887] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.596289] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.596448] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.596558] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.596779] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.596906] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.598435] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 03169133-27d3-46d9-90ce-df708ffba627 is going to be created. [ 608.621130] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.621412] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.621544] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.621893] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.623762] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.624062] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-03169133-27d3-46d9-90ce-df708ffba627" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.626141] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.626316] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.626372] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.626576] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.626722] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.641933] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d777850f-4bcd-420d-ab88-295134770a5c in Status: IN_PROGRESS for 2s [ 608.805198] env[66502]: INFO networking_nsxv3.common.synchronization [None req-30997eb3-f3dd-4a89-bbf9-b9839835e152 None None] Enqueued Resource ID: 0bff92bd-d093-4246-bc16-91a20d05d1b3 with Priority: HIGHEST for action port [ 608.805198] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bff92bd-d093-4246-bc16-91a20d05d1b3 with Priority: HIGHEST for action port [ 608.805198] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-0bff92bd-d093-4246-bc16-91a20d05d1b3 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.805198] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0bff92bd-d093-4246-bc16-91a20d05d1b3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.805198] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0bff92bd-d093-4246-bc16-91a20d05d1b3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.805868] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0bff92bd-d093-4246-bc16-91a20d05d1b3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.806079] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bff92bd-d093-4246-bc16-91a20d05d1b3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.967878] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.968202] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.968407] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.968581] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.968724] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.968861] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75e42630-d365-4bb0-89c0-55b0baee0268 is going to be created. [ 609.032183] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.032335] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.032395] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.032666] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.032845] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.047666] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75e42630-d365-4bb0-89c0-55b0baee0268 in Status: UNINITIALIZED for 2s [ 609.309293] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0bff92bd-d093-4246-bc16-91a20d05d1b3 [ 609.309293] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.309293] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.309293] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.309293] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.309293] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.309293] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0bff92bd-d093-4246-bc16-91a20d05d1b3 already deleted. [ 609.309293] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0bff92bd-d093-4246-bc16-91a20d05d1b3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.334623] env[66502]: INFO networking_nsxv3.common.synchronization [req-98993bf1-9174-483f-8b9b-0c54e1ae61a8 req-b658eb8d-d8a6-4ab7-8eb1-fc17f26449e3 service nova] Enqueued Resource ID: 75e42630-d365-4bb0-89c0-55b0baee0268 with Priority: HIGHEST for action security_group_rules [ 609.334623] env[66502]: INFO networking_nsxv3.common.synchronization [req-98993bf1-9174-483f-8b9b-0c54e1ae61a8 req-b658eb8d-d8a6-4ab7-8eb1-fc17f26449e3 service nova] Enqueued Resource ID: 75e42630-d365-4bb0-89c0-55b0baee0268 with Priority: HIGHEST for action security_group_members [ 609.334623] env[66502]: INFO networking_nsxv3.common.synchronization [req-98993bf1-9174-483f-8b9b-0c54e1ae61a8 req-b658eb8d-d8a6-4ab7-8eb1-fc17f26449e3 service nova] Enqueued Resource ID: 03169133-27d3-46d9-90ce-df708ffba627 with Priority: HIGHEST for action port [ 609.334623] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75e42630-d365-4bb0-89c0-55b0baee0268 with Priority: HIGHEST for action security_group_rules [ 609.334623] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75e42630-d365-4bb0-89c0-55b0baee0268 with Priority: HIGHEST for action security_group_members [ 609.334623] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03169133-27d3-46d9-90ce-df708ffba627 with Priority: HIGHEST for action port [ 609.334623] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75e42630-d365-4bb0-89c0-55b0baee0268 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.334623] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.334623] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e42630-d365-4bb0-89c0-55b0baee0268 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.334623] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.335237] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-03169133-27d3-46d9-90ce-df708ffba627 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.335506] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03169133-27d3-46d9-90ce-df708ffba627" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.335774] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03169133-27d3-46d9-90ce-df708ffba627" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.336246] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03169133-27d3-46d9-90ce-df708ffba627" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.336683] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03169133-27d3-46d9-90ce-df708ffba627',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.841034] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 03169133-27d3-46d9-90ce-df708ffba627 with status ACTIVE [ 609.841289] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.841395] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.842094] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.842094] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.842094] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.842094] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.842094] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.842094] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.842502] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.842502] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.842502] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.842975] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.842975] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.842975] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.842975] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.842975] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 03169133-27d3-46d9-90ce-df708ffba627 is going to be updated. [ 609.866543] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.866698] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.866787] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.867540] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.867540] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.867540] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03169133-27d3-46d9-90ce-df708ffba627" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.655714] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d777850f-4bcd-420d-ab88-295134770a5c in Status: SUCCESS [ 610.655967] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.656166] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.656404] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.656619] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.656724] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.656778] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.656945] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.657058] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.657152] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d777850f-4bcd-420d-ab88-295134770a5c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.059680] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75e42630-d365-4bb0-89c0-55b0baee0268 in Status: SUCCESS [ 611.059680] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.059680] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.060095] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.060095] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.060095] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.060211] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.060385] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.060385] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.060518] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75e42630-d365-4bb0-89c0-55b0baee0268',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.160458] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d777850f-4bcd-420d-ab88-295134770a5c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.564578] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75e42630-d365-4bb0-89c0-55b0baee0268',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.663324] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d777850f-4bcd-420d-ab88-295134770a5c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.068902] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75e42630-d365-4bb0-89c0-55b0baee0268',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.165740] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.165933] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.166073] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.166273] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.166378] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.166463] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d777850f-4bcd-420d-ab88-295134770a5c is going to be updated. [ 612.202673] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.202880] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.202937] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.203231] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.203686] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.217059] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d777850f-4bcd-420d-ab88-295134770a5c in Status: IN_PROGRESS for 2s [ 612.572037] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.572037] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.572244] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.572320] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.572413] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.572574] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75e42630-d365-4bb0-89c0-55b0baee0268 is going to be updated. [ 612.604309] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.604309] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.604309] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.604490] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.604683] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.618090] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75e42630-d365-4bb0-89c0-55b0baee0268 in Status: IN_PROGRESS for 2s [ 613.368309] env[66502]: INFO networking_nsxv3.common.synchronization [req-100059b9-410f-431a-b494-b37a81f3fad1 req-90845bf6-8c0a-41d8-9fae-ce5d15589d74 tempest-DeleteServersAdminTestJSON-1090984952 tempest-DeleteServersAdminTestJSON-1090984952-project-admin] Enqueued Resource ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 with Priority: HIGHEST for action security_group_members [ 613.368806] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 with Priority: HIGHEST for action security_group_members [ 613.369680] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-67c97dc5-9d08-4219-aa00-0b83a223ae57 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.369680] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.369680] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.369680] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.369903] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.369903] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.369976] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.370121] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.370209] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.370302] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67c97dc5-9d08-4219-aa00-0b83a223ae57',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.874578] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.874722] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.874722] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.874961] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.876834] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.876834] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.876834] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.876834] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.876834] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.876834] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.876834] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 is going to be updated. [ 613.921038] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.921266] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.921323] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.921543] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.922130] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.933496] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 in Status: IN_PROGRESS for 2s [ 614.231463] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d777850f-4bcd-420d-ab88-295134770a5c in Status: SUCCESS [ 614.231769] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.231952] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.232935] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.232935] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.233130] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.233130] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.233427] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.233558] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.234023] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.234023] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-d777850f-4bcd-420d-ab88-295134770a5c taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.235818] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.237727] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.238279] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.238434] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.238614] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.238723] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.239033] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.239153] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.239282] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.239412] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d777850f-4bcd-420d-ab88-295134770a5c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.240757] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.240896] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.245494] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.245494] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.245684] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.245951] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.245951] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.246150] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d777850f-4bcd-420d-ab88-295134770a5c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.575934] env[66502]: INFO networking_nsxv3.common.synchronization [None req-d6d03104-c783-4391-85b3-701ee6034f8f tempest-ServersWithSpecificFlavorTestJSON-713469048 tempest-ServersWithSpecificFlavorTestJSON-713469048-project-member] Enqueued Resource ID: 7421254e-fac2-4232-97e1-1f7373688543 with Priority: HIGHEST for action security_group_rules [ 614.577224] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7421254e-fac2-4232-97e1-1f7373688543 with Priority: HIGHEST for action security_group_rules [ 614.577514] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7421254e-fac2-4232-97e1-1f7373688543 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.577716] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.577716] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.577985] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.578129] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7421254e-fac2-4232-97e1-1f7373688543',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.631292] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75e42630-d365-4bb0-89c0-55b0baee0268 in Status: SUCCESS [ 614.631292] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.631292] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.631575] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.632229] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.632229] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.632229] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.633624] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.633624] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.633624] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.633624] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('75e42630-d365-4bb0-89c0-55b0baee0268',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.634048] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.634940] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.634940] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.634940] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.634940] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.634940] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.634940] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.634940] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75e42630-d365-4bb0-89c0-55b0baee0268',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.723755] env[66502]: INFO networking_nsxv3.common.synchronization [None req-3ff6d265-c8d7-4abd-a4a9-17251979c2f1 tempest-ServersWithSpecificFlavorTestJSON-713469048 tempest-ServersWithSpecificFlavorTestJSON-713469048-project-member] Enqueued Resource ID: 7421254e-fac2-4232-97e1-1f7373688543 with Priority: HIGHEST for action security_group_rules [ 614.726143] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7421254e-fac2-4232-97e1-1f7373688543 with Priority: HIGHEST for action security_group_rules [ 614.726143] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7421254e-fac2-4232-97e1-1f7373688543 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.726143] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.748315] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d777850f-4bcd-420d-ab88-295134770a5c: rpc.has_security_group_logging(os_id): False [ 614.759645] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d777850f-4bcd-420d-ab88-295134770a5c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.773638] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.773638] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.773638] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.773638] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.773638] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.773638] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.773638] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.773638] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.773638] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.773638] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.773638] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.773638] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.773638] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.773638] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.773638] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.774145] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.774145] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.774145] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.776219] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.776219] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.776219] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d777850f-4bcd-420d-ab88-295134770a5c is going to be created. [ 614.854745] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.855337] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.855337] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.855337] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.855650] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.871074] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d777850f-4bcd-420d-ab88-295134770a5c in Status: IN_PROGRESS for 2s [ 615.102784] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.103264] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.103426] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.104529] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.104529] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.104529] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7421254e-fac2-4232-97e1-1f7373688543 already deleted. [ 615.104529] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.104529] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.104529] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.104529] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7421254e-fac2-4232-97e1-1f7373688543',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.138490] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75e42630-d365-4bb0-89c0-55b0baee0268',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.139616] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e42630-d365-4bb0-89c0-55b0baee0268 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.139791] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.252083] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d777850f-4bcd-420d-ab88-295134770a5c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.626270] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.626685] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.626685] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.627279] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.627367] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.627623] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7421254e-fac2-4232-97e1-1f7373688543 already deleted. [ 615.627809] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.642194] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75e42630-d365-4bb0-89c0-55b0baee0268',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.756183] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.756183] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.756183] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.756183] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.756183] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.756183] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d777850f-4bcd-420d-ab88-295134770a5c is going to be updated. [ 615.792817] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.793024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.793072] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.793851] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.793851] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.808986] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d777850f-4bcd-420d-ab88-295134770a5c in Status: IN_PROGRESS for 2s [ 615.947390] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 in Status: SUCCESS [ 615.947753] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 deletion is rescheduled due to dependency. [ 615.947753] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.989576] env[66502]: INFO networking_nsxv3.common.synchronization [req-05821be6-c967-4d45-8919-73fdae629af5 req-0e44f509-e014-4923-a055-680a02682b36 tempest-ServerDiagnosticsTest-2078655975 tempest-ServerDiagnosticsTest-2078655975-project-member] Enqueued Resource ID: 6215e376-fd44-487b-9cf4-9b65dd953e4e with Priority: HIGHEST for action security_group_members [ 615.990574] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6215e376-fd44-487b-9cf4-9b65dd953e4e with Priority: HIGHEST for action security_group_members [ 615.991675] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6215e376-fd44-487b-9cf4-9b65dd953e4e taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.991943] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6215e376-fd44-487b-9cf4-9b65dd953e4e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.992103] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6215e376-fd44-487b-9cf4-9b65dd953e4e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.992385] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6215e376-fd44-487b-9cf4-9b65dd953e4e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.992651] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.992819] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.992928] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.993243] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.993393] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.993511] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6215e376-fd44-487b-9cf4-9b65dd953e4e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.144433] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.144728] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.144728] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.144996] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.145106] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.145211] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75e42630-d365-4bb0-89c0-55b0baee0268 is going to be updated. [ 616.180479] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.180479] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.180479] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.180727] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.180909] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.192058] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75e42630-d365-4bb0-89c0-55b0baee0268 in Status: IN_PROGRESS for 2s [ 616.370365] env[66502]: INFO networking_nsxv3.common.synchronization [req-6790c781-7aaa-494f-8add-7acd8bda4d80 req-31d4c245-1be9-4f68-9eab-7135b2f9dcf3 tempest-MigrationsAdminTest-636676794 tempest-MigrationsAdminTest-636676794-project-member] Enqueued Resource ID: b4dfff3d-ef74-48f2-8955-b975cccf84d9 with Priority: HIGHEST for action security_group_members [ 616.370973] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4dfff3d-ef74-48f2-8955-b975cccf84d9 with Priority: HIGHEST for action security_group_members [ 616.371310] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4dfff3d-ef74-48f2-8955-b975cccf84d9 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.371658] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.371658] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.371846] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.371895] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.372015] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.376443] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.376738] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.377216] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.377434] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4dfff3d-ef74-48f2-8955-b975cccf84d9',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.500045] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.500045] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.500045] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.500045] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.500045] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.500609] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.503183] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.503183] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.503183] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.503183] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.503183] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6215e376-fd44-487b-9cf4-9b65dd953e4e is going to be updated. [ 616.536608] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.536760] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.536825] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.537074] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.537211] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.550141] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6215e376-fd44-487b-9cf4-9b65dd953e4e in Status: IN_PROGRESS for 2s [ 616.597613] env[66502]: INFO networking_nsxv3.common.synchronization [req-3a0fcad7-454f-44dd-a69b-c4de1b998772 req-2b4ae854-c90a-491b-b2bc-287798c32dbc tempest-TenantUsagesTestJSON-1983695498 tempest-TenantUsagesTestJSON-1983695498-project-member] Enqueued Resource ID: 10c7f564-e48d-436c-95ae-202237b0b833 with Priority: HIGHEST for action security_group_members [ 616.598203] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10c7f564-e48d-436c-95ae-202237b0b833 with Priority: HIGHEST for action security_group_members [ 616.598512] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-10c7f564-e48d-436c-95ae-202237b0b833 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.598635] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-10c7f564-e48d-436c-95ae-202237b0b833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.598701] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-10c7f564-e48d-436c-95ae-202237b0b833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.598903] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-10c7f564-e48d-436c-95ae-202237b0b833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.600174] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.600327] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.600327] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.600691] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.600691] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.600691] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('10c7f564-e48d-436c-95ae-202237b0b833',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.879436] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.879764] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.879764] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.880261] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.880261] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.880261] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.880261] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.880558] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.880558] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.880558] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.880655] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4dfff3d-ef74-48f2-8955-b975cccf84d9 already deleted. [ 616.880717] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.889838] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d777850f-4bcd-420d-ab88-295134770a5c in Status: SUCCESS [ 616.889838] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.889962] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.890252] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.890343] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d777850f-4bcd-420d-ab88-295134770a5c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.025054] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-670 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.025400] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.025400] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.025784] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.026044] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.026235] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.026369] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.026660] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.026778] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.027172] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 617.027304] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 617.027414] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 617.027530] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 617.027660] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 617.027884] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 617.027949] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 617.052866] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 617.053466] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 617.053466] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 617.053466] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.053832] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-8a59b864-8bbd-4a9d-a305-915c732c4997 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.054069] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-8a59b864-8bbd-4a9d-a305-915c732c4997" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.054218] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-8a59b864-8bbd-4a9d-a305-915c732c4997" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.054760] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-8a59b864-8bbd-4a9d-a305-915c732c4997" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.054760] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a59b864-8bbd-4a9d-a305-915c732c4997',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.104160] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.104466] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.104466] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.104824] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.104934] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.105242] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.105369] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.105450] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.105655] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.105756] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.105877] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10c7f564-e48d-436c-95ae-202237b0b833 is going to be updated. [ 617.136168] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.136337] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.136421] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.136672] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.136830] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.146839] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10c7f564-e48d-436c-95ae-202237b0b833 in Status: IN_PROGRESS for 2s [ 617.392478] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-d777850f-4bcd-420d-ab88-295134770a5c taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.392632] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.557690] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.558015] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.558087] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.558571] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.558571] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.558780] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 8a59b864-8bbd-4a9d-a305-915c732c4997 not found, creating... [ 617.558943] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.559517] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.559640] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.559883] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.560065] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.560391] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.560587] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.560869] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.561108] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.561269] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.561388] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 8a59b864-8bbd-4a9d-a305-915c732c4997 is going to be created. [ 617.585164] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.585419] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.585540] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.585916] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.586168] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.586403] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-8a59b864-8bbd-4a9d-a305-915c732c4997" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.822897] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d777850f-4bcd-420d-ab88-295134770a5c in Status: SUCCESS [ 617.822897] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.822897] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.822897] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.822897] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.822897] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.822897] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.822897] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.822897] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.822897] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.822897] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d777850f-4bcd-420d-ab88-295134770a5c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.914556] env[66502]: INFO networking_nsxv3.common.synchronization [req-4c61bf7f-0ba2-490a-8f16-00509ce4df2b req-70b60b19-4eec-4f38-8ed1-bc1960541746 tempest-ImagesNegativeTestJSON-744524934 tempest-ImagesNegativeTestJSON-744524934-project-member] Enqueued Resource ID: 25ed9582-5ba1-4260-bd41-77518f4c6d14 with Priority: HIGHEST for action security_group_members [ 617.915172] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25ed9582-5ba1-4260-bd41-77518f4c6d14 with Priority: HIGHEST for action security_group_members [ 617.915489] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-25ed9582-5ba1-4260-bd41-77518f4c6d14 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.915608] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25ed9582-5ba1-4260-bd41-77518f4c6d14" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.915706] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25ed9582-5ba1-4260-bd41-77518f4c6d14" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.915937] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25ed9582-5ba1-4260-bd41-77518f4c6d14" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.916506] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.916702] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.916806] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.917011] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.917138] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.917263] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25ed9582-5ba1-4260-bd41-77518f4c6d14',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.203523] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75e42630-d365-4bb0-89c0-55b0baee0268 in Status: SUCCESS [ 618.203788] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.204061] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.204346] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.204485] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.204605] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.204747] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.204977] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.204977] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.205125] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.205294] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e42630-d365-4bb0-89c0-55b0baee0268 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.205398] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.205398] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.205523] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.205687] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.205820] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.205820] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.205934] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.205996] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.206136] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.206300] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('75e42630-d365-4bb0-89c0-55b0baee0268',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.292129] env[66502]: INFO networking_nsxv3.common.synchronization [req-6790c781-7aaa-494f-8add-7acd8bda4d80 req-3ed38fc1-3b0f-4906-a0d0-6ec326f34684 service nova] Enqueued Resource ID: b4dfff3d-ef74-48f2-8955-b975cccf84d9 with Priority: HIGHEST for action security_group_rules [ 618.292378] env[66502]: INFO networking_nsxv3.common.synchronization [req-6790c781-7aaa-494f-8add-7acd8bda4d80 req-3ed38fc1-3b0f-4906-a0d0-6ec326f34684 service nova] Enqueued Resource ID: b4dfff3d-ef74-48f2-8955-b975cccf84d9 with Priority: HIGHEST for action security_group_members [ 618.292605] env[66502]: INFO networking_nsxv3.common.synchronization [req-6790c781-7aaa-494f-8add-7acd8bda4d80 req-3ed38fc1-3b0f-4906-a0d0-6ec326f34684 service nova] Enqueued Resource ID: 8a59b864-8bbd-4a9d-a305-915c732c4997 with Priority: HIGHEST for action port [ 618.293675] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4dfff3d-ef74-48f2-8955-b975cccf84d9 with Priority: HIGHEST for action security_group_rules [ 618.293965] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4dfff3d-ef74-48f2-8955-b975cccf84d9 with Priority: HIGHEST for action security_group_members [ 618.294361] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a59b864-8bbd-4a9d-a305-915c732c4997 with Priority: HIGHEST for action port [ 618.294722] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4dfff3d-ef74-48f2-8955-b975cccf84d9 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.294985] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.295149] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.295447] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.295598] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4dfff3d-ef74-48f2-8955-b975cccf84d9',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.296883] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4dfff3d-ef74-48f2-8955-b975cccf84d9 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.297924] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.298054] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.298322] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.298591] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.298762] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.298887] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.299103] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.299230] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.299340] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4dfff3d-ef74-48f2-8955-b975cccf84d9',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.300225] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a59b864-8bbd-4a9d-a305-915c732c4997 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.300387] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a59b864-8bbd-4a9d-a305-915c732c4997" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.300425] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a59b864-8bbd-4a9d-a305-915c732c4997" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.300677] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a59b864-8bbd-4a9d-a305-915c732c4997" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.300677] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a59b864-8bbd-4a9d-a305-915c732c4997',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.324348] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-d777850f-4bcd-420d-ab88-295134770a5c taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.324540] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.324588] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.325249] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.325481] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.326641] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.326641] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.326641] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.326641] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.326641] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.326909] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-d777850f-4bcd-420d-ab88-295134770a5c taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.326909] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.326909] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.327080] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.327356] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.327456] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.327707] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.327849] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.328281] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.328571] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.328748] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d777850f-4bcd-420d-ab88-295134770a5c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.414139] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-323 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.414370] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-323" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.414492] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-323" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.414879] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-323" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.415194] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.415390] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.415520] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.415759] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.415930] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.416195] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 618.416304] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 618.416417] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 618.416518] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 618.416620] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 618.416758] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 618.416889] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 618.421007] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.421155] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.421221] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.421409] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.421501] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.421693] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.421793] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.421859] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.422012] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.422090] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.422172] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25ed9582-5ba1-4260-bd41-77518f4c6d14 already deleted. [ 618.422252] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25ed9582-5ba1-4260-bd41-77518f4c6d14" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.437993] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 618.438265] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 618.438456] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 618.438693] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-323" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.439076] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-89e3416b-cfc6-428b-b17b-2fa52941fb81 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.439251] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-89e3416b-cfc6-428b-b17b-2fa52941fb81" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.439366] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-89e3416b-cfc6-428b-b17b-2fa52941fb81" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.439678] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-89e3416b-cfc6-428b-b17b-2fa52941fb81" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.439812] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89e3416b-cfc6-428b-b17b-2fa52941fb81',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.561631] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6215e376-fd44-487b-9cf4-9b65dd953e4e in Status: SUCCESS [ 618.561809] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6215e376-fd44-487b-9cf4-9b65dd953e4e deletion is rescheduled due to dependency. [ 618.562321] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6215e376-fd44-487b-9cf4-9b65dd953e4e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.708621] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 75e42630-d365-4bb0-89c0-55b0baee0268: rpc.has_security_group_logging(os_id): False [ 618.731140] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.731435] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.731435] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.731621] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.731724] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.731944] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.732050] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.732104] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.732295] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.732367] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.732949] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.732949] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.732949] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.732949] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.733212] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.733252] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.733317] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.733389] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.733539] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.733605] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.733703] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75e42630-d365-4bb0-89c0-55b0baee0268 is going to be created. [ 618.797992] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.797992] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.798154] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.798376] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.798729] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.807424] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4dfff3d-ef74-48f2-8955-b975cccf84d9 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.807682] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.807878] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4dfff3d-ef74-48f2-8955-b975cccf84d9',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.809373] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8a59b864-8bbd-4a9d-a305-915c732c4997 with status ACTIVE [ 618.809906] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.809906] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.810096] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.810337] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.810483] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.810787] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.810991] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.811146] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.811421] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.811559] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.811905] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.812151] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.812275] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.812494] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.812636] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.812892] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8a59b864-8bbd-4a9d-a305-915c732c4997 is going to be updated. [ 618.818393] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75e42630-d365-4bb0-89c0-55b0baee0268 in Status: IN_PROGRESS for 2s [ 618.831569] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d777850f-4bcd-420d-ab88-295134770a5c: rpc.has_security_group_logging(os_id): False [ 618.836301] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.836522] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.836580] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.836894] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.837056] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.837280] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a59b864-8bbd-4a9d-a305-915c732c4997" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.852770] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.852972] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.853126] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.853409] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.853562] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.853870] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.854038] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.854144] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.854374] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.854488] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.854814] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.854987] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.855104] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.855274] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.855385] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.855705] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.855856] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.855952] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.856178] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.856297] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.856423] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d777850f-4bcd-420d-ab88-295134770a5c is going to be updated. [ 618.945418] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.946036] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.946222] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.946621] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.946857] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.947203] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port 89e3416b-cfc6-428b-b17b-2fa52941fb81 not found, creating... [ 618.947702] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.947979] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.948186] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.948547] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.948780] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.949344] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.949609] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.949817] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.950199] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.950434] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.950679] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: 89e3416b-cfc6-428b-b17b-2fa52941fb81 is going to be created. [ 618.962401] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.962548] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.962615] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.962850] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.962998] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.990036] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d777850f-4bcd-420d-ab88-295134770a5c in Status: IN_PROGRESS for 2s [ 618.995050] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.995320] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.995320] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.995577] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.995836] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.996071] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-89e3416b-cfc6-428b-b17b-2fa52941fb81" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.164476] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 10c7f564-e48d-436c-95ae-202237b0b833 in Status: SUCCESS [ 619.164631] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 10c7f564-e48d-436c-95ae-202237b0b833 deletion is rescheduled due to dependency. [ 619.164819] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-10c7f564-e48d-436c-95ae-202237b0b833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.317573] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4dfff3d-ef74-48f2-8955-b975cccf84d9',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.716891] env[66502]: INFO networking_nsxv3.common.synchronization [req-4c61bf7f-0ba2-490a-8f16-00509ce4df2b req-dce90b0c-3ce4-47ec-b990-03adfc04ed8a service nova] Enqueued Resource ID: 25ed9582-5ba1-4260-bd41-77518f4c6d14 with Priority: HIGHEST for action security_group_rules [ 619.717137] env[66502]: INFO networking_nsxv3.common.synchronization [req-4c61bf7f-0ba2-490a-8f16-00509ce4df2b req-dce90b0c-3ce4-47ec-b990-03adfc04ed8a service nova] Enqueued Resource ID: 25ed9582-5ba1-4260-bd41-77518f4c6d14 with Priority: HIGHEST for action security_group_members [ 619.717298] env[66502]: INFO networking_nsxv3.common.synchronization [req-4c61bf7f-0ba2-490a-8f16-00509ce4df2b req-dce90b0c-3ce4-47ec-b990-03adfc04ed8a service nova] Enqueued Resource ID: 89e3416b-cfc6-428b-b17b-2fa52941fb81 with Priority: HIGHEST for action port [ 619.718081] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25ed9582-5ba1-4260-bd41-77518f4c6d14 with Priority: HIGHEST for action security_group_rules [ 619.718251] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25ed9582-5ba1-4260-bd41-77518f4c6d14 with Priority: HIGHEST for action security_group_members [ 619.718352] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89e3416b-cfc6-428b-b17b-2fa52941fb81 with Priority: HIGHEST for action port [ 619.718663] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25ed9582-5ba1-4260-bd41-77518f4c6d14 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.718790] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25ed9582-5ba1-4260-bd41-77518f4c6d14" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.718850] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25ed9582-5ba1-4260-bd41-77518f4c6d14" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.719203] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25ed9582-5ba1-4260-bd41-77518f4c6d14" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.719295] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25ed9582-5ba1-4260-bd41-77518f4c6d14',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.720207] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-25ed9582-5ba1-4260-bd41-77518f4c6d14 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.720621] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25ed9582-5ba1-4260-bd41-77518f4c6d14" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.720621] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25ed9582-5ba1-4260-bd41-77518f4c6d14" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.720621] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25ed9582-5ba1-4260-bd41-77518f4c6d14" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.720755] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.720871] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.720907] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.721042] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.721158] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.721254] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25ed9582-5ba1-4260-bd41-77518f4c6d14',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.724749] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-89e3416b-cfc6-428b-b17b-2fa52941fb81 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.724872] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89e3416b-cfc6-428b-b17b-2fa52941fb81" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.724926] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89e3416b-cfc6-428b-b17b-2fa52941fb81" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.725143] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89e3416b-cfc6-428b-b17b-2fa52941fb81" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.725337] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89e3416b-cfc6-428b-b17b-2fa52941fb81',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.820944] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.821127] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.821201] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.821429] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.821516] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.821611] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4dfff3d-ef74-48f2-8955-b975cccf84d9 is going to be created. [ 619.850224] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.850371] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.850433] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.850643] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.850800] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.862242] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4dfff3d-ef74-48f2-8955-b975cccf84d9 in Status: UNINITIALIZED for 2s [ 620.181329] env[66502]: INFO networking_nsxv3.common.synchronization [req-ffb67beb-938a-476f-9eba-75fbdbaf9258 req-4ea2f285-3680-4d18-b4c1-94033941a8a7 tempest-ServerPasswordTestJSON-1011645008 tempest-ServerPasswordTestJSON-1011645008-project-member] Enqueued Resource ID: 96893623-1913-4658-8960-6e93015a062e with Priority: HIGHEST for action security_group_members [ 620.182123] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96893623-1913-4658-8960-6e93015a062e with Priority: HIGHEST for action security_group_members [ 620.182648] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-96893623-1913-4658-8960-6e93015a062e taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.182816] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96893623-1913-4658-8960-6e93015a062e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.183090] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96893623-1913-4658-8960-6e93015a062e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.183353] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96893623-1913-4658-8960-6e93015a062e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.183631] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.183955] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.184034] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.184527] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.184527] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.184681] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96893623-1913-4658-8960-6e93015a062e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.227225] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-25ed9582-5ba1-4260-bd41-77518f4c6d14 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.227438] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25ed9582-5ba1-4260-bd41-77518f4c6d14" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.227614] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('25ed9582-5ba1-4260-bd41-77518f4c6d14',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.228465] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 89e3416b-cfc6-428b-b17b-2fa52941fb81 with status ACTIVE [ 620.228657] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.228770] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.228836] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.229058] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.229146] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.229373] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.229670] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.229670] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.229766] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.229800] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.229982] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.230093] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.230153] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.230295] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.230368] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.230451] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 89e3416b-cfc6-428b-b17b-2fa52941fb81 is going to be updated. [ 620.253784] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.254245] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.254245] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.254245] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.254430] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.254529] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89e3416b-cfc6-428b-b17b-2fa52941fb81" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.626045] env[66502]: INFO networking_nsxv3.common.synchronization [None req-307ecda1-d93e-4966-9acb-135a3d1bbbd6 None None] Enqueued Resource ID: 727ee230-46df-4089-9491-2a69927b815d with Priority: HIGHEST for action port [ 620.626339] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 727ee230-46df-4089-9491-2a69927b815d with Priority: HIGHEST for action port [ 620.627033] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-727ee230-46df-4089-9491-2a69927b815d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.627033] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-727ee230-46df-4089-9491-2a69927b815d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.627033] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-727ee230-46df-4089-9491-2a69927b815d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.627875] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-727ee230-46df-4089-9491-2a69927b815d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.627975] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('727ee230-46df-4089-9491-2a69927b815d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.687500] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.687697] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.687756] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.688011] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.689046] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.689429] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.689593] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.689685] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.689876] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.689971] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.690083] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96893623-1913-4658-8960-6e93015a062e already deleted. [ 620.690205] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96893623-1913-4658-8960-6e93015a062e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.732371] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('25ed9582-5ba1-4260-bd41-77518f4c6d14',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.796291] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-623 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.796574] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-623" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.796692] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-623" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.797173] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-623" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.797501] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.797739] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.798031] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.798164] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.798310] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.798533] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 620.798633] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 620.798825] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 620.798825] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 620.798982] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 620.799046] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 620.799302] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 620.831428] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 620.831671] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 620.831851] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 620.832082] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-623" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.832448] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-6580ce53-f369-4029-8e37-52ad41d81f21 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.832654] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-6580ce53-f369-4029-8e37-52ad41d81f21" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.832792] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-6580ce53-f369-4029-8e37-52ad41d81f21" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.833164] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-6580ce53-f369-4029-8e37-52ad41d81f21" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.833302] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6580ce53-f369-4029-8e37-52ad41d81f21',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 620.844987] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75e42630-d365-4bb0-89c0-55b0baee0268 in Status: SUCCESS [ 620.845240] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.845414] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.845644] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.845955] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75e42630-d365-4bb0-89c0-55b0baee0268',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.001399] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d777850f-4bcd-420d-ab88-295134770a5c in Status: SUCCESS [ 621.001600] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.001770] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.001992] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.002086] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d777850f-4bcd-420d-ab88-295134770a5c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.129953] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 727ee230-46df-4089-9491-2a69927b815d [ 621.130377] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.130663] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.130832] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.131140] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.131321] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.131505] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:727ee230-46df-4089-9491-2a69927b815d already deleted. [ 621.131880] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-727ee230-46df-4089-9491-2a69927b815d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.235465] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.236232] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.236408] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.236741] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.236833] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.236887] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25ed9582-5ba1-4260-bd41-77518f4c6d14 is going to be created. [ 621.264065] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.264065] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.264065] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.264354] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.264424] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.277078] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25ed9582-5ba1-4260-bd41-77518f4c6d14 in Status: UNINITIALIZED for 2s [ 621.337458] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.337458] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.337458] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.337458] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.337458] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.337458] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port 6580ce53-f369-4029-8e37-52ad41d81f21 not found, creating... [ 621.337458] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.337458] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.337458] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.338249] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.338628] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.339019] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.339814] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.339814] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.339814] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.340033] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.340271] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: 6580ce53-f369-4029-8e37-52ad41d81f21 is going to be created. [ 621.348345] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e42630-d365-4bb0-89c0-55b0baee0268 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.349211] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.349416] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.352032] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.352032] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.352032] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.352032] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.352032] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.352032] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.352032] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.352032] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('75e42630-d365-4bb0-89c0-55b0baee0268',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.366743] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.366956] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.366956] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.368393] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.368661] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.368886] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-6580ce53-f369-4029-8e37-52ad41d81f21" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.503858] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-d777850f-4bcd-420d-ab88-295134770a5c taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.504031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.504109] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.504384] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.504574] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.504713] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.504796] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.505798] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.505798] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.505798] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.505798] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d777850f-4bcd-420d-ab88-295134770a5c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.854050] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e42630-d365-4bb0-89c0-55b0baee0268 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.854236] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.854452] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.854508] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.854732] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.854870] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.854911] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.855286] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.855286] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.855286] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.855429] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e42630-d365-4bb0-89c0-55b0baee0268 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.856018] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.856018] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.856018] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.856018] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.856018] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.856018] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.856387] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.856387] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.856387] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.856483] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('75e42630-d365-4bb0-89c0-55b0baee0268',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.874052] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4dfff3d-ef74-48f2-8955-b975cccf84d9 in Status: SUCCESS [ 621.874052] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.874052] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.874052] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.874052] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.874052] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.874052] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.874052] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.874466] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.874466] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.874466] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b4dfff3d-ef74-48f2-8955-b975cccf84d9',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.012715] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-d777850f-4bcd-420d-ab88-295134770a5c taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.012715] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.012715] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.012715] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.012715] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.012715] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.012715] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.012715] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.012715] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.012715] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.012715] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-d777850f-4bcd-420d-ab88-295134770a5c taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.012715] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.012715] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.012715] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.012715] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.012715] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.013503] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.015929] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.016068] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.016177] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.016300] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d777850f-4bcd-420d-ab88-295134770a5c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.176853] env[66502]: INFO networking_nsxv3.common.synchronization [req-ffb67beb-938a-476f-9eba-75fbdbaf9258 req-1d24233f-1df2-4b07-9ab8-265c409785cd service nova] Enqueued Resource ID: 96893623-1913-4658-8960-6e93015a062e with Priority: HIGHEST for action security_group_rules [ 622.177049] env[66502]: INFO networking_nsxv3.common.synchronization [req-ffb67beb-938a-476f-9eba-75fbdbaf9258 req-1d24233f-1df2-4b07-9ab8-265c409785cd service nova] Enqueued Resource ID: 96893623-1913-4658-8960-6e93015a062e with Priority: HIGHEST for action security_group_members [ 622.177199] env[66502]: INFO networking_nsxv3.common.synchronization [req-ffb67beb-938a-476f-9eba-75fbdbaf9258 req-1d24233f-1df2-4b07-9ab8-265c409785cd service nova] Enqueued Resource ID: 6580ce53-f369-4029-8e37-52ad41d81f21 with Priority: HIGHEST for action port [ 622.177712] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96893623-1913-4658-8960-6e93015a062e with Priority: HIGHEST for action security_group_rules [ 622.177847] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96893623-1913-4658-8960-6e93015a062e with Priority: HIGHEST for action security_group_members [ 622.179301] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6580ce53-f369-4029-8e37-52ad41d81f21 with Priority: HIGHEST for action port [ 622.183512] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-96893623-1913-4658-8960-6e93015a062e taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.183512] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-96893623-1913-4658-8960-6e93015a062e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.183512] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-96893623-1913-4658-8960-6e93015a062e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.183512] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-96893623-1913-4658-8960-6e93015a062e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.183512] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('96893623-1913-4658-8960-6e93015a062e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.183512] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-96893623-1913-4658-8960-6e93015a062e taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.183512] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96893623-1913-4658-8960-6e93015a062e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.183512] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96893623-1913-4658-8960-6e93015a062e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.183512] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96893623-1913-4658-8960-6e93015a062e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.183512] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.183512] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.183512] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.183512] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.183512] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.183512] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96893623-1913-4658-8960-6e93015a062e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.189313] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-6580ce53-f369-4029-8e37-52ad41d81f21 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.189313] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6580ce53-f369-4029-8e37-52ad41d81f21" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.189313] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6580ce53-f369-4029-8e37-52ad41d81f21" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.189313] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6580ce53-f369-4029-8e37-52ad41d81f21" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.189313] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6580ce53-f369-4029-8e37-52ad41d81f21',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.364400] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 75e42630-d365-4bb0-89c0-55b0baee0268: rpc.has_security_group_logging(os_id): False [ 622.377807] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4dfff3d-ef74-48f2-8955-b975cccf84d9 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.379380] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.379469] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.379724] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.379939] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.380067] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.380132] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.380352] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.383238] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.383238] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.383238] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4dfff3d-ef74-48f2-8955-b975cccf84d9 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.383238] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.383238] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.383238] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.384966] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.385094] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.385209] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.385493] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.385634] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.385791] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.385861] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b4dfff3d-ef74-48f2-8955-b975cccf84d9',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.389713] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.390285] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.390450] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.390761] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.390873] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.391218] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.391380] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.391457] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.394212] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.394212] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.394212] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.394212] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.394212] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.394212] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.394212] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.394212] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.394212] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.394212] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.394212] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.394737] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.394737] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75e42630-d365-4bb0-89c0-55b0baee0268 is going to be updated. [ 622.468322] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.468322] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.468322] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.468462] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.468523] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.483599] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75e42630-d365-4bb0-89c0-55b0baee0268 in Status: IN_PROGRESS for 2s [ 622.522788] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d777850f-4bcd-420d-ab88-295134770a5c: rpc.has_security_group_logging(os_id): False [ 622.541641] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.541832] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.541883] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.542095] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.542182] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.542407] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.542702] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.542702] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.542865] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.542865] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.542999] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.543108] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.543170] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.543313] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.543388] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.543574] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.543668] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.543729] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.545818] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.545818] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.545818] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d777850f-4bcd-420d-ab88-295134770a5c is going to be updated. [ 622.633625] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.633625] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.634478] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.634478] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.634478] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.656057] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d777850f-4bcd-420d-ab88-295134770a5c in Status: IN_PROGRESS for 2s [ 622.667111] env[66502]: INFO networking_nsxv3.common.synchronization [req-94cf8af6-41f4-4db4-a1f8-b00642bf3ff0 req-be13f89d-0580-4fdc-ae8c-5ede12571c00 tempest-VolumesAssistedSnapshotsTest-591155639 tempest-VolumesAssistedSnapshotsTest-591155639-project-member] Enqueued Resource ID: bb24e830-31ca-4b75-ba92-3835430fbf29 with Priority: HIGHEST for action security_group_members [ 622.667952] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb24e830-31ca-4b75-ba92-3835430fbf29 with Priority: HIGHEST for action security_group_members [ 622.668364] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb24e830-31ca-4b75-ba92-3835430fbf29 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.668725] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb24e830-31ca-4b75-ba92-3835430fbf29" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.669250] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb24e830-31ca-4b75-ba92-3835430fbf29" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.669250] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb24e830-31ca-4b75-ba92-3835430fbf29" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.669250] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.669418] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.669457] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.669587] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.669669] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.670050] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb24e830-31ca-4b75-ba92-3835430fbf29',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.689866] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-96893623-1913-4658-8960-6e93015a062e taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.690037] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96893623-1913-4658-8960-6e93015a062e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.690165] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('96893623-1913-4658-8960-6e93015a062e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.691911] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6580ce53-f369-4029-8e37-52ad41d81f21 with status ACTIVE [ 622.691911] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.691911] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.691911] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.691911] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.691911] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.691911] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.691911] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.691911] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.694314] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.694314] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.694314] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.694314] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.694314] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.694314] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.694314] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.694314] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6580ce53-f369-4029-8e37-52ad41d81f21 is going to be updated. [ 622.718647] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.718860] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.718921] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.719123] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.719262] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.719427] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6580ce53-f369-4029-8e37-52ad41d81f21" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.898355] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b4dfff3d-ef74-48f2-8955-b975cccf84d9: rpc.has_security_group_logging(os_id): False [ 622.920333] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.920568] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.920568] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.920769] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.920850] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.921101] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.921952] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.921952] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.921952] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.921952] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.921952] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.921952] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.921952] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.921952] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.921952] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.922527] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.922527] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.922527] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.922527] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.922527] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.922809] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4dfff3d-ef74-48f2-8955-b975cccf84d9 is going to be created. [ 622.993465] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.993631] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.993729] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.994116] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.994215] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.008779] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4dfff3d-ef74-48f2-8955-b975cccf84d9 in Status: IN_PROGRESS for 2s [ 623.036281] env[66502]: INFO networking_nsxv3.common.synchronization [None req-94dfb6fe-9db2-4625-bb70-7c583a7bf709 None None] Enqueued Resource ID: 98e67c3c-0f40-4adf-8e15-cbea4b639388 with Priority: HIGHEST for action port [ 623.036281] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98e67c3c-0f40-4adf-8e15-cbea4b639388 with Priority: HIGHEST for action port [ 623.036493] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-98e67c3c-0f40-4adf-8e15-cbea4b639388 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.036767] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98e67c3c-0f40-4adf-8e15-cbea4b639388" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.036943] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98e67c3c-0f40-4adf-8e15-cbea4b639388" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.037289] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98e67c3c-0f40-4adf-8e15-cbea4b639388" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.037475] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98e67c3c-0f40-4adf-8e15-cbea4b639388',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.165408] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-9 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.165652] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.165766] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.166120] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.166396] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.166514] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.166714] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.168732] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.168732] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.168732] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 623.168732] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 623.168732] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 623.168732] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 623.168732] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 623.168732] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 623.168732] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 623.175214] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.175428] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.175428] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.175739] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.176159] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.176159] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.176159] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.176302] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.177222] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.177344] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.177654] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb24e830-31ca-4b75-ba92-3835430fbf29 already deleted. [ 623.177654] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb24e830-31ca-4b75-ba92-3835430fbf29" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.192022] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 623.192022] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 623.192022] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 623.192022] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.192022] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-4d7f937b-1a3b-48bb-b3e2-7d248bacf646 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.192022] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-4d7f937b-1a3b-48bb-b3e2-7d248bacf646" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.192728] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-4d7f937b-1a3b-48bb-b3e2-7d248bacf646" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.193435] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-4d7f937b-1a3b-48bb-b3e2-7d248bacf646" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.194651] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d7f937b-1a3b-48bb-b3e2-7d248bacf646',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.196960] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('96893623-1913-4658-8960-6e93015a062e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.288823] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25ed9582-5ba1-4260-bd41-77518f4c6d14 in Status: SUCCESS [ 623.288996] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25ed9582-5ba1-4260-bd41-77518f4c6d14" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.289759] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25ed9582-5ba1-4260-bd41-77518f4c6d14" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.290014] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25ed9582-5ba1-4260-bd41-77518f4c6d14" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.290395] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.290632] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.290720] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.291028] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.291205] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.291470] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25ed9582-5ba1-4260-bd41-77518f4c6d14" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.291588] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('25ed9582-5ba1-4260-bd41-77518f4c6d14',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 623.540120] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 98e67c3c-0f40-4adf-8e15-cbea4b639388 [ 623.540671] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.540867] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.540959] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.541234] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.541343] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.541455] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:98e67c3c-0f40-4adf-8e15-cbea4b639388 already deleted. [ 623.541541] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98e67c3c-0f40-4adf-8e15-cbea4b639388" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.699623] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.699913] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.699992] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.700432] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.700612] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.700809] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 4d7f937b-1a3b-48bb-b3e2-7d248bacf646 not found, creating... [ 623.701128] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.701305] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.701652] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.701733] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.701927] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.702254] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.702421] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.702627] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.702870] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.703058] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.703154] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 4d7f937b-1a3b-48bb-b3e2-7d248bacf646 is going to be created. [ 623.704412] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.704524] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.704591] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.704772] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.704853] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.704941] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96893623-1913-4658-8960-6e93015a062e is going to be created. [ 623.730708] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.730964] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.731144] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.731454] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.731891] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.732157] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-4d7f937b-1a3b-48bb-b3e2-7d248bacf646" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.733930] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.734072] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.734134] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.734320] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.734459] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.748313] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96893623-1913-4658-8960-6e93015a062e in Status: UNINITIALIZED for 2s [ 623.794225] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-25ed9582-5ba1-4260-bd41-77518f4c6d14 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.794432] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25ed9582-5ba1-4260-bd41-77518f4c6d14" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.794488] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25ed9582-5ba1-4260-bd41-77518f4c6d14" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.794806] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25ed9582-5ba1-4260-bd41-77518f4c6d14" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.795071] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.795215] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.795270] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.795434] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.795596] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.795753] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25ed9582-5ba1-4260-bd41-77518f4c6d14" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.795980] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-25ed9582-5ba1-4260-bd41-77518f4c6d14 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.796102] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25ed9582-5ba1-4260-bd41-77518f4c6d14" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.796182] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25ed9582-5ba1-4260-bd41-77518f4c6d14" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.796335] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25ed9582-5ba1-4260-bd41-77518f4c6d14" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.796478] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 623.796571] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 623.796634] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 623.796788] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 623.796865] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.797015] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25ed9582-5ba1-4260-bd41-77518f4c6d14" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 623.797081] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('25ed9582-5ba1-4260-bd41-77518f4c6d14',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.299621] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 25ed9582-5ba1-4260-bd41-77518f4c6d14: rpc.has_security_group_logging(os_id): False [ 624.325184] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.325389] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.325459] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.325679] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.325910] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.326257] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.326257] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.326257] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.326515] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.326515] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.326653] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.326653] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.326733] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.326980] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.326980] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.327573] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.327573] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.327573] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.327698] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.327974] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.327974] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25ed9582-5ba1-4260-bd41-77518f4c6d14 is going to be created. [ 624.389770] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.389966] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.389966] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.390215] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.390386] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.404926] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25ed9582-5ba1-4260-bd41-77518f4c6d14 in Status: IN_PROGRESS for 2s [ 624.429946] env[66502]: INFO networking_nsxv3.common.synchronization [req-94cf8af6-41f4-4db4-a1f8-b00642bf3ff0 req-ad6b8d20-a67a-4ec6-a869-a4b9f49fa523 service nova] Enqueued Resource ID: bb24e830-31ca-4b75-ba92-3835430fbf29 with Priority: HIGHEST for action security_group_rules [ 624.429946] env[66502]: INFO networking_nsxv3.common.synchronization [req-94cf8af6-41f4-4db4-a1f8-b00642bf3ff0 req-ad6b8d20-a67a-4ec6-a869-a4b9f49fa523 service nova] Enqueued Resource ID: bb24e830-31ca-4b75-ba92-3835430fbf29 with Priority: HIGHEST for action security_group_members [ 624.429946] env[66502]: INFO networking_nsxv3.common.synchronization [req-94cf8af6-41f4-4db4-a1f8-b00642bf3ff0 req-ad6b8d20-a67a-4ec6-a869-a4b9f49fa523 service nova] Enqueued Resource ID: 4d7f937b-1a3b-48bb-b3e2-7d248bacf646 with Priority: HIGHEST for action port [ 624.429946] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb24e830-31ca-4b75-ba92-3835430fbf29 with Priority: HIGHEST for action security_group_rules [ 624.429946] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb24e830-31ca-4b75-ba92-3835430fbf29 with Priority: HIGHEST for action security_group_members [ 624.429946] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d7f937b-1a3b-48bb-b3e2-7d248bacf646 with Priority: HIGHEST for action port [ 624.432188] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb24e830-31ca-4b75-ba92-3835430fbf29 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.432188] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb24e830-31ca-4b75-ba92-3835430fbf29" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.432188] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb24e830-31ca-4b75-ba92-3835430fbf29" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.432188] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb24e830-31ca-4b75-ba92-3835430fbf29" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.432188] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb24e830-31ca-4b75-ba92-3835430fbf29',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.432610] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb24e830-31ca-4b75-ba92-3835430fbf29 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.432610] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb24e830-31ca-4b75-ba92-3835430fbf29" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.432610] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb24e830-31ca-4b75-ba92-3835430fbf29" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.432830] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb24e830-31ca-4b75-ba92-3835430fbf29" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.432902] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.432990] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.433056] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.433491] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.433491] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.433491] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb24e830-31ca-4b75-ba92-3835430fbf29',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.434062] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d7f937b-1a3b-48bb-b3e2-7d248bacf646 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.434176] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d7f937b-1a3b-48bb-b3e2-7d248bacf646" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.434519] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d7f937b-1a3b-48bb-b3e2-7d248bacf646" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.434519] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d7f937b-1a3b-48bb-b3e2-7d248bacf646" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.434519] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d7f937b-1a3b-48bb-b3e2-7d248bacf646',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.506616] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75e42630-d365-4bb0-89c0-55b0baee0268 in Status: SUCCESS [ 624.506935] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.674328] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d777850f-4bcd-420d-ab88-295134770a5c in Status: SUCCESS [ 624.674328] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.935853] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb24e830-31ca-4b75-ba92-3835430fbf29 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.936018] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb24e830-31ca-4b75-ba92-3835430fbf29" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.936472] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bb24e830-31ca-4b75-ba92-3835430fbf29',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.937312] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4d7f937b-1a3b-48bb-b3e2-7d248bacf646 with status ACTIVE [ 624.938034] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.938034] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.938034] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.938034] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.938034] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.938280] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.938280] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.938280] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.938385] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.938694] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.938694] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.938694] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.939538] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.939538] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.939538] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.939538] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4d7f937b-1a3b-48bb-b3e2-7d248bacf646 is going to be updated. [ 624.965510] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.965510] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.966180] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.966180] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.966180] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.966180] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d7f937b-1a3b-48bb-b3e2-7d248bacf646" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.043484] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4dfff3d-ef74-48f2-8955-b975cccf84d9 in Status: SUCCESS [ 625.043829] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.425154] env[66502]: INFO networking_nsxv3.common.synchronization [req-9e379ef1-d250-48c5-958e-1cb2306bef88 req-ad302037-c6f8-4374-b793-6475c3a532ca tempest-FloatingIPsAssociationTestJSON-843355077 tempest-FloatingIPsAssociationTestJSON-843355077-project-member] Enqueued Resource ID: e12852c1-7dc2-4ed2-bd34-e396f9f9256d with Priority: HIGHEST for action security_group_members [ 625.425760] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e12852c1-7dc2-4ed2-bd34-e396f9f9256d with Priority: HIGHEST for action security_group_members [ 625.426932] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.427106] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.427156] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.427850] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.428417] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.428417] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.428417] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.428417] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.428623] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.428623] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e12852c1-7dc2-4ed2-bd34-e396f9f9256d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.442509] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bb24e830-31ca-4b75-ba92-3835430fbf29',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.766497] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96893623-1913-4658-8960-6e93015a062e in Status: SUCCESS [ 625.766497] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96893623-1913-4658-8960-6e93015a062e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.766497] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96893623-1913-4658-8960-6e93015a062e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.766497] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96893623-1913-4658-8960-6e93015a062e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.766497] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.766497] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.766497] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.766497] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.767548] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.769774] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96893623-1913-4658-8960-6e93015a062e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.769774] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('96893623-1913-4658-8960-6e93015a062e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.865219] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-84 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.865421] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-84" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.865540] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-84" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.866222] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-84" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.866485] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.866741] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.866741] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.867136] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.867305] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.867507] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 625.867616] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 625.867786] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 625.867865] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 625.867991] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 625.868138] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 625.868270] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 625.887341] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 625.887511] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 625.888049] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 625.888256] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-84" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.888567] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-9a24bce0-4bb2-4944-b245-8cea3fb48c41 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.888734] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-9a24bce0-4bb2-4944-b245-8cea3fb48c41" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.889120] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-9a24bce0-4bb2-4944-b245-8cea3fb48c41" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.889456] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-9a24bce0-4bb2-4944-b245-8cea3fb48c41" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.889592] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a24bce0-4bb2-4944-b245-8cea3fb48c41',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.932088] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.932332] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.932332] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.932546] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.932719] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.932858] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.932958] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.933028] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.933185] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.933261] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.933344] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e12852c1-7dc2-4ed2-bd34-e396f9f9256d already deleted. [ 625.933420] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.945909] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.945909] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.945909] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.946300] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.946384] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.946523] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb24e830-31ca-4b75-ba92-3835430fbf29 is going to be created. [ 625.977153] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.977320] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.977383] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.977592] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.977749] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.989808] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb24e830-31ca-4b75-ba92-3835430fbf29 in Status: UNINITIALIZED for 2s [ 626.273111] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-96893623-1913-4658-8960-6e93015a062e taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.273405] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96893623-1913-4658-8960-6e93015a062e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.274125] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96893623-1913-4658-8960-6e93015a062e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.274433] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96893623-1913-4658-8960-6e93015a062e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.274635] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.274934] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.275120] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.275439] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.275590] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.275797] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96893623-1913-4658-8960-6e93015a062e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.276155] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-96893623-1913-4658-8960-6e93015a062e taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.276501] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96893623-1913-4658-8960-6e93015a062e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.276501] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96893623-1913-4658-8960-6e93015a062e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.276649] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96893623-1913-4658-8960-6e93015a062e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.276894] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.277225] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.277407] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.277600] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.277738] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.277882] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96893623-1913-4658-8960-6e93015a062e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.278047] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('96893623-1913-4658-8960-6e93015a062e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.394789] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.395085] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.395270] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.395597] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.395917] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.396239] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port 9a24bce0-4bb2-4944-b245-8cea3fb48c41 not found, creating... [ 626.396589] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.396804] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.396964] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.397265] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.397477] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.397890] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.399509] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.399728] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.400148] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.400407] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.400669] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: 9a24bce0-4bb2-4944-b245-8cea3fb48c41 is going to be created. [ 626.425644] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 25ed9582-5ba1-4260-bd41-77518f4c6d14 in Status: SUCCESS [ 626.425956] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25ed9582-5ba1-4260-bd41-77518f4c6d14" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.427501] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.427761] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.427927] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.428359] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.428713] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.428976] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-9a24bce0-4bb2-4944-b245-8cea3fb48c41" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.780159] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 96893623-1913-4658-8960-6e93015a062e: rpc.has_security_group_logging(os_id): False [ 626.800873] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.801032] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.801208] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.801314] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.801410] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.801627] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.801729] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.801791] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.801960] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.802050] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.802222] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.802313] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.802362] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.802510] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.802639] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.802772] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.802896] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.802931] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.803070] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.803142] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.803227] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 96893623-1913-4658-8960-6e93015a062e is going to be created. [ 626.892650] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.892650] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.892650] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.892650] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.892650] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.905681] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96893623-1913-4658-8960-6e93015a062e in Status: IN_PROGRESS for 2s [ 627.154596] env[66502]: INFO networking_nsxv3.common.synchronization [req-9e379ef1-d250-48c5-958e-1cb2306bef88 req-5435010d-8239-45fa-b23d-d1e73427ed8a service nova] Enqueued Resource ID: e12852c1-7dc2-4ed2-bd34-e396f9f9256d with Priority: HIGHEST for action security_group_rules [ 627.154859] env[66502]: INFO networking_nsxv3.common.synchronization [req-9e379ef1-d250-48c5-958e-1cb2306bef88 req-5435010d-8239-45fa-b23d-d1e73427ed8a service nova] Enqueued Resource ID: e12852c1-7dc2-4ed2-bd34-e396f9f9256d with Priority: HIGHEST for action security_group_members [ 627.154969] env[66502]: INFO networking_nsxv3.common.synchronization [req-9e379ef1-d250-48c5-958e-1cb2306bef88 req-5435010d-8239-45fa-b23d-d1e73427ed8a service nova] Enqueued Resource ID: 9a24bce0-4bb2-4944-b245-8cea3fb48c41 with Priority: HIGHEST for action port [ 627.155590] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e12852c1-7dc2-4ed2-bd34-e396f9f9256d with Priority: HIGHEST for action security_group_rules [ 627.155738] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e12852c1-7dc2-4ed2-bd34-e396f9f9256d with Priority: HIGHEST for action security_group_members [ 627.155830] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9a24bce0-4bb2-4944-b245-8cea3fb48c41 with Priority: HIGHEST for action port [ 627.156218] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e12852c1-7dc2-4ed2-bd34-e396f9f9256d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.156367] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.156449] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.156789] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.156878] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e12852c1-7dc2-4ed2-bd34-e396f9f9256d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.159091] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.159166] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.159209] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.159468] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.159654] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.159760] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.159820] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.159990] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.160257] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.160397] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e12852c1-7dc2-4ed2-bd34-e396f9f9256d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.161536] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-9a24bce0-4bb2-4944-b245-8cea3fb48c41 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.161536] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9a24bce0-4bb2-4944-b245-8cea3fb48c41" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.161536] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9a24bce0-4bb2-4944-b245-8cea3fb48c41" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.161686] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9a24bce0-4bb2-4944-b245-8cea3fb48c41" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.161686] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9a24bce0-4bb2-4944-b245-8cea3fb48c41',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.663771] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.664000] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.664237] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9a24bce0-4bb2-4944-b245-8cea3fb48c41 with status ACTIVE [ 627.664448] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.664580] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.664660] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.666732] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.666880] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.667185] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.667340] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.667412] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.667588] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.667663] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.667853] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.667981] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.668096] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.668259] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.668345] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.668421] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9a24bce0-4bb2-4944-b245-8cea3fb48c41 is going to be updated. [ 627.669997] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e12852c1-7dc2-4ed2-bd34-e396f9f9256d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.697610] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.697610] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.697610] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.697610] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.697610] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.697610] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9a24bce0-4bb2-4944-b245-8cea3fb48c41" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.001451] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb24e830-31ca-4b75-ba92-3835430fbf29 in Status: SUCCESS [ 628.001817] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb24e830-31ca-4b75-ba92-3835430fbf29" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.001954] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb24e830-31ca-4b75-ba92-3835430fbf29" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.002234] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb24e830-31ca-4b75-ba92-3835430fbf29" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.002426] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.002556] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.002623] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.002786] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.002873] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.002962] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb24e830-31ca-4b75-ba92-3835430fbf29" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.003070] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bb24e830-31ca-4b75-ba92-3835430fbf29',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.172752] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e12852c1-7dc2-4ed2-bd34-e396f9f9256d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.221189] env[66502]: INFO networking_nsxv3.common.synchronization [req-7c7e37fb-210b-4b18-ad2e-5e1babf0b9c6 req-a3223804-5c12-4159-8c94-8252dba169c8 tempest-ImagesOneServerNegativeTestJSON-1621881971 tempest-ImagesOneServerNegativeTestJSON-1621881971-project-member] Enqueued Resource ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 with Priority: HIGHEST for action security_group_members [ 628.222022] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 with Priority: HIGHEST for action security_group_members [ 628.222565] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.222928] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.223229] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.223659] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.223967] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.225148] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.225148] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.225148] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.225148] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.225148] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ddb3b9a8-c63d-4123-aa7f-cbf2b5279231',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.514981] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bb24e830-31ca-4b75-ba92-3835430fbf29',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.623503] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-885 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.623771] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-885" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.623858] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-885" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.624271] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-885" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.628038] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.628038] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.628038] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.628038] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.628038] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.628038] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 628.628038] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 628.628038] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 628.628038] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 628.628038] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 628.628038] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 628.628038] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 628.673920] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 628.673920] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.046 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 628.673920] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 628.673920] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-885" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.674265] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-5abfa075-f867-4ccf-9ce9-1633a9e91a3c taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.674487] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-5abfa075-f867-4ccf-9ce9-1633a9e91a3c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.674600] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-5abfa075-f867-4ccf-9ce9-1633a9e91a3c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.675110] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-5abfa075-f867-4ccf-9ce9-1633a9e91a3c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.675376] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5abfa075-f867-4ccf-9ce9-1633a9e91a3c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 628.677342] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.677523] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.677635] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.677920] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.678076] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.678209] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e12852c1-7dc2-4ed2-bd34-e396f9f9256d is going to be created. [ 628.719967] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.720267] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.720372] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.720697] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.720950] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.729466] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.729466] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.729466] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.730238] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.730238] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.730238] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.730412] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.730412] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.730708] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.730860] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.731107] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 already deleted. [ 628.732089] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.737614] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e12852c1-7dc2-4ed2-bd34-e396f9f9256d in Status: UNINITIALIZED for 2s [ 628.925472] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 96893623-1913-4658-8960-6e93015a062e in Status: SUCCESS [ 628.926577] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-96893623-1913-4658-8960-6e93015a062e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.017980] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bb24e830-31ca-4b75-ba92-3835430fbf29: rpc.has_security_group_logging(os_id): False [ 629.049027] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.049027] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.049027] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.049027] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.049027] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.049027] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.049027] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.049027] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.049027] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.049027] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.049027] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb24e830-31ca-4b75-ba92-3835430fbf29 is going to be created. [ 629.170742] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.170742] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.170742] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.170742] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.170742] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.184040] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.184040] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.184040] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.184040] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.184040] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.184040] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 5abfa075-f867-4ccf-9ce9-1633a9e91a3c not found, creating... [ 629.184040] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.184040] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.184040] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.184040] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.184947] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.185447] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.185876] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.186191] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.186645] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.187044] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.187325] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 5abfa075-f867-4ccf-9ce9-1633a9e91a3c is going to be created. [ 629.205578] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb24e830-31ca-4b75-ba92-3835430fbf29 in Status: IN_PROGRESS for 2s [ 629.220344] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.220344] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.220344] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.220344] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.220344] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.220344] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-5abfa075-f867-4ccf-9ce9-1633a9e91a3c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.030223] env[66502]: INFO networking_nsxv3.common.synchronization [req-7c7e37fb-210b-4b18-ad2e-5e1babf0b9c6 req-aec76de3-3f73-49e6-a688-03a13a98ef31 service nova] Enqueued Resource ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 with Priority: HIGHEST for action security_group_rules [ 630.030592] env[66502]: INFO networking_nsxv3.common.synchronization [req-7c7e37fb-210b-4b18-ad2e-5e1babf0b9c6 req-aec76de3-3f73-49e6-a688-03a13a98ef31 service nova] Enqueued Resource ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 with Priority: HIGHEST for action security_group_members [ 630.030592] env[66502]: INFO networking_nsxv3.common.synchronization [req-7c7e37fb-210b-4b18-ad2e-5e1babf0b9c6 req-aec76de3-3f73-49e6-a688-03a13a98ef31 service nova] Enqueued Resource ID: 5abfa075-f867-4ccf-9ce9-1633a9e91a3c with Priority: HIGHEST for action port [ 630.031122] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 with Priority: HIGHEST for action security_group_rules [ 630.031175] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 with Priority: HIGHEST for action security_group_members [ 630.031229] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5abfa075-f867-4ccf-9ce9-1633a9e91a3c with Priority: HIGHEST for action port [ 630.031506] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.031743] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.031743] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.031987] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.032226] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ddb3b9a8-c63d-4123-aa7f-cbf2b5279231',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.034672] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.034932] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.034932] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.036825] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.036825] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.036825] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.036825] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.037733] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.037733] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.037733] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ddb3b9a8-c63d-4123-aa7f-cbf2b5279231',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.039772] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-5abfa075-f867-4ccf-9ce9-1633a9e91a3c taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.040044] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5abfa075-f867-4ccf-9ce9-1633a9e91a3c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.040044] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5abfa075-f867-4ccf-9ce9-1633a9e91a3c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.040424] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5abfa075-f867-4ccf-9ce9-1633a9e91a3c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.040424] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5abfa075-f867-4ccf-9ce9-1633a9e91a3c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.535762] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.536107] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.547098] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ddb3b9a8-c63d-4123-aa7f-cbf2b5279231',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.547211] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5abfa075-f867-4ccf-9ce9-1633a9e91a3c with status ACTIVE [ 630.547827] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.548029] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.548092] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.548468] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.548468] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.548620] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.548724] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.548787] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.548938] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.549559] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.549811] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.549941] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.550013] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.550190] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.550274] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.550363] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5abfa075-f867-4ccf-9ce9-1633a9e91a3c is going to be updated. [ 630.580025] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.580025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.580025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.580025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.580025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.580025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5abfa075-f867-4ccf-9ce9-1633a9e91a3c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.759992] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e12852c1-7dc2-4ed2-bd34-e396f9f9256d in Status: SUCCESS [ 630.762032] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.762328] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.762604] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.762861] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.763038] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.763203] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.763355] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.763472] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.763583] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.763698] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e12852c1-7dc2-4ed2-bd34-e396f9f9256d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.052787] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ddb3b9a8-c63d-4123-aa7f-cbf2b5279231',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.225462] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bb24e830-31ca-4b75-ba92-3835430fbf29 in Status: SUCCESS [ 631.226360] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb24e830-31ca-4b75-ba92-3835430fbf29" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.267616] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.267785] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.267867] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.268114] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.268286] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.268489] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.268542] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.268734] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.272106] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.272307] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.272504] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.272605] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.272780] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.272953] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.273156] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.273213] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.273293] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.273430] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.273493] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.273575] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.273668] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e12852c1-7dc2-4ed2-bd34-e396f9f9256d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.520225] env[66502]: INFO networking_nsxv3.common.synchronization [req-0d28608d-bf25-4455-b365-d96a973f434a req-9a63fef8-dea5-44bb-8094-47c2beadea15 tempest-MultipleCreateTestJSON-1551479830 tempest-MultipleCreateTestJSON-1551479830-project-member] Enqueued Resource ID: 75e42630-d365-4bb0-89c0-55b0baee0268 with Priority: HIGHEST for action security_group_members [ 631.520772] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75e42630-d365-4bb0-89c0-55b0baee0268 with Priority: HIGHEST for action security_group_members [ 631.521254] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e42630-d365-4bb0-89c0-55b0baee0268 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.523222] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.523222] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.523441] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.523615] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.523721] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.523781] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.524052] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.524324] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.524324] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75e42630-d365-4bb0-89c0-55b0baee0268',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.557437] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.557668] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.557668] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.557892] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.558012] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.558546] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 is going to be created. [ 631.590185] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.590185] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.590185] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.590185] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.591225] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.606905] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 in Status: UNINITIALIZED for 2s [ 631.775955] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e12852c1-7dc2-4ed2-bd34-e396f9f9256d: rpc.has_security_group_logging(os_id): False [ 631.782819] env[66502]: INFO networking_nsxv3.common.synchronization [req-63253211-4e3a-49dd-ace3-2d143f0406ab req-f645f1a7-5542-4da2-9c8c-04a84ebed17b tempest-ListServersNegativeTestJSON-658181297 tempest-ListServersNegativeTestJSON-658181297-project-member] Enqueued Resource ID: d777850f-4bcd-420d-ab88-295134770a5c with Priority: HIGHEST for action security_group_members [ 631.783334] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d777850f-4bcd-420d-ab88-295134770a5c with Priority: HIGHEST for action security_group_members [ 631.783751] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-d777850f-4bcd-420d-ab88-295134770a5c taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.783854] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.783921] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.785136] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.785339] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.785461] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.785528] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.785708] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.785822] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.785933] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d777850f-4bcd-420d-ab88-295134770a5c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.800556] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.800940] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.800940] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.802072] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.802244] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.802490] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.802610] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.802720] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.802939] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.803043] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.803330] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.803434] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.803434] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.803594] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.803665] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.803848] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.803944] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.804055] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.804157] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.804231] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.804317] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e12852c1-7dc2-4ed2-bd34-e396f9f9256d is going to be created. [ 631.895916] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.895916] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.895916] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.895916] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.895916] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.910421] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e12852c1-7dc2-4ed2-bd34-e396f9f9256d in Status: IN_PROGRESS for 2s [ 632.027728] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75e42630-d365-4bb0-89c0-55b0baee0268',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.289931] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d777850f-4bcd-420d-ab88-295134770a5c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.532326] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75e42630-d365-4bb0-89c0-55b0baee0268',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.793998] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d777850f-4bcd-420d-ab88-295134770a5c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.037332] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.039158] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.039158] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.039158] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.039158] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.039158] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75e42630-d365-4bb0-89c0-55b0baee0268 is going to be updated. [ 633.075123] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.075348] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.075544] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.075765] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.075951] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.089943] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75e42630-d365-4bb0-89c0-55b0baee0268 in Status: IN_PROGRESS for 2s [ 633.296465] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.297140] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.297140] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.297140] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.297273] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.297307] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d777850f-4bcd-420d-ab88-295134770a5c is going to be updated. [ 633.352897] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.353192] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.353192] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.353346] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.353455] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.370905] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d777850f-4bcd-420d-ab88-295134770a5c in Status: IN_PROGRESS for 2s [ 633.399746] env[66502]: INFO networking_nsxv3.common.synchronization [None req-c97948d9-0f1b-4a55-b218-eb23d70312a4 None None] Enqueued Resource ID: 554d759c-d433-4bc2-8d03-4e4a04c7ffe5 with Priority: HIGHEST for action port [ 633.400388] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 554d759c-d433-4bc2-8d03-4e4a04c7ffe5 with Priority: HIGHEST for action port [ 633.400633] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-554d759c-d433-4bc2-8d03-4e4a04c7ffe5 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.400758] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-554d759c-d433-4bc2-8d03-4e4a04c7ffe5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.400825] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-554d759c-d433-4bc2-8d03-4e4a04c7ffe5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.401462] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-554d759c-d433-4bc2-8d03-4e4a04c7ffe5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.401574] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('554d759c-d433-4bc2-8d03-4e4a04c7ffe5',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.524637] env[66502]: INFO networking_nsxv3.common.synchronization [req-ba0668b9-23ff-4a0e-8838-6b1f6ccdff32 req-681691a6-b47c-46ed-907a-ec4ee59ee7aa tempest-DeleteServersTestJSON-51385704 tempest-DeleteServersTestJSON-51385704-project-member] Enqueued Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_members [ 633.525750] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_members [ 633.526820] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-704e5eab-aa44-4493-8c9a-0b24250e7bea taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.526820] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.526820] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.527347] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.527506] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.527746] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.528069] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.528252] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.528415] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.528639] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.623031] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 in Status: SUCCESS [ 633.623031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.623031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.623031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.623031] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.623031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.623031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.623031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.623031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.623031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.623031] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ddb3b9a8-c63d-4123-aa7f-cbf2b5279231',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.903690] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 554d759c-d433-4bc2-8d03-4e4a04c7ffe5 [ 633.903932] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.904084] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.904150] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.904394] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.904501] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.904611] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:554d759c-d433-4bc2-8d03-4e4a04c7ffe5 already deleted. [ 633.904716] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-554d759c-d433-4bc2-8d03-4e4a04c7ffe5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.925050] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e12852c1-7dc2-4ed2-bd34-e396f9f9256d in Status: SUCCESS [ 633.925050] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.032269] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.032509] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.032509] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.032784] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.032921] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.033184] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.033290] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.033347] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.033538] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.033622] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.033865] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea already deleted. [ 634.033865] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.127192] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.127620] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.127620] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.127832] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.127940] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.128092] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.128176] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.128373] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.128846] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.129059] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.129544] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.129544] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.129544] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.129865] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.129865] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.129974] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.130226] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.130716] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.130848] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.130966] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.131106] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ddb3b9a8-c63d-4123-aa7f-cbf2b5279231',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.637200] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ddb3b9a8-c63d-4123-aa7f-cbf2b5279231: rpc.has_security_group_logging(os_id): False [ 634.657117] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.657357] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.657438] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.658051] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.658051] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.658287] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.658395] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.658465] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.658830] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.658965] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.660424] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.660593] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.661204] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.661451] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.661560] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.661830] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.661992] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.662079] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.662292] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.662394] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.663103] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 is going to be created. [ 634.736459] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.738658] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.738658] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.738658] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.738658] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.751514] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 in Status: IN_PROGRESS for 2s [ 634.948144] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-608 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.948459] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-608" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.948583] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-608" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.949665] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-608" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.950095] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.950295] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.950535] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.951073] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.951288] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.951525] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 634.951659] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 634.951783] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 634.951925] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 634.952067] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 634.952197] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 634.952369] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 634.981071] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 634.981403] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 634.981628] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 634.981923] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-608" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.982410] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-240c6599-5988-41da-b054-2385d4f51627 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.982692] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-240c6599-5988-41da-b054-2385d4f51627" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.982898] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-240c6599-5988-41da-b054-2385d4f51627" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.983489] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-240c6599-5988-41da-b054-2385d4f51627" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.983614] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('240c6599-5988-41da-b054-2385d4f51627',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.109501] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75e42630-d365-4bb0-89c0-55b0baee0268 in Status: SUCCESS [ 635.109710] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.142390] env[66502]: INFO networking_nsxv3.common.synchronization [req-9adad381-0836-4d62-9bc7-9729d602b842 req-140a4e43-c27b-4f25-bedc-b6e0e4a06b67 tempest-MultipleCreateTestJSON-1551479830 tempest-MultipleCreateTestJSON-1551479830-project-member] Enqueued Resource ID: 75e42630-d365-4bb0-89c0-55b0baee0268 with Priority: HIGHEST for action security_group_members [ 635.142980] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75e42630-d365-4bb0-89c0-55b0baee0268 with Priority: HIGHEST for action security_group_members [ 635.143307] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e42630-d365-4bb0-89c0-55b0baee0268 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.143429] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.143506] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.143694] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.143846] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.143945] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.144009] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.144167] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.144253] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.144366] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75e42630-d365-4bb0-89c0-55b0baee0268',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.381461] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d777850f-4bcd-420d-ab88-295134770a5c in Status: SUCCESS [ 635.381782] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.487494] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.487814] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.487984] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.488376] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.488550] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.488757] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 240c6599-5988-41da-b054-2385d4f51627 not found, creating... [ 635.489083] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.489256] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.489588] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.489880] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.490241] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.490652] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.490948] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.491182] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.491506] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.491889] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.492125] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 240c6599-5988-41da-b054-2385d4f51627 is going to be created. [ 635.516414] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.516666] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.516789] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.517169] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.517398] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.517700] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-240c6599-5988-41da-b054-2385d4f51627" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.642207] env[66502]: INFO networking_nsxv3.common.synchronization [None req-b0251669-2031-41e1-a772-592f3cb579d1 None None] Enqueued Resource ID: fe93c2eb-1d81-4b01-9a6b-3ab936a6bab3 with Priority: HIGHEST for action port [ 635.643735] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe93c2eb-1d81-4b01-9a6b-3ab936a6bab3 with Priority: HIGHEST for action port [ 635.643866] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe93c2eb-1d81-4b01-9a6b-3ab936a6bab3 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.644163] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe93c2eb-1d81-4b01-9a6b-3ab936a6bab3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.644316] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe93c2eb-1d81-4b01-9a6b-3ab936a6bab3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.644707] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe93c2eb-1d81-4b01-9a6b-3ab936a6bab3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.645058] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe93c2eb-1d81-4b01-9a6b-3ab936a6bab3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.647665] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.647902] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.648035] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.649414] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.649414] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.649414] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.649414] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.649414] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.649414] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.649720] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.649720] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75e42630-d365-4bb0-89c0-55b0baee0268 is going to be updated. [ 635.687090] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.687331] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.687420] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.687696] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.687858] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.699776] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75e42630-d365-4bb0-89c0-55b0baee0268 in Status: IN_PROGRESS for 2s [ 636.094230] env[66502]: INFO networking_nsxv3.common.synchronization [None req-f08ee480-70c7-48dd-afed-c75dd0649604 None None] Enqueued Resource ID: 1a5a07a1-ca36-4e1d-b6a2-e2bc41edb087 with Priority: HIGHEST for action port [ 636.094965] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1a5a07a1-ca36-4e1d-b6a2-e2bc41edb087 with Priority: HIGHEST for action port [ 636.096064] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-1a5a07a1-ca36-4e1d-b6a2-e2bc41edb087 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.099137] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1a5a07a1-ca36-4e1d-b6a2-e2bc41edb087" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.099208] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1a5a07a1-ca36-4e1d-b6a2-e2bc41edb087" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.099439] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1a5a07a1-ca36-4e1d-b6a2-e2bc41edb087" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.099531] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1a5a07a1-ca36-4e1d-b6a2-e2bc41edb087',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.152577] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fe93c2eb-1d81-4b01-9a6b-3ab936a6bab3 [ 636.152834] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.152942] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.153123] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.153241] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.153330] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.153602] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fe93c2eb-1d81-4b01-9a6b-3ab936a6bab3 already deleted. [ 636.153602] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe93c2eb-1d81-4b01-9a6b-3ab936a6bab3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.286859] env[66502]: INFO networking_nsxv3.common.synchronization [req-ba0668b9-23ff-4a0e-8838-6b1f6ccdff32 req-65ac7187-da75-4565-b279-99ebd364fa9f service nova] Enqueued Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_rules [ 636.287088] env[66502]: INFO networking_nsxv3.common.synchronization [req-ba0668b9-23ff-4a0e-8838-6b1f6ccdff32 req-65ac7187-da75-4565-b279-99ebd364fa9f service nova] Enqueued Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_members [ 636.287228] env[66502]: INFO networking_nsxv3.common.synchronization [req-ba0668b9-23ff-4a0e-8838-6b1f6ccdff32 req-65ac7187-da75-4565-b279-99ebd364fa9f service nova] Enqueued Resource ID: 240c6599-5988-41da-b054-2385d4f51627 with Priority: HIGHEST for action port [ 636.287864] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_rules [ 636.288682] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_members [ 636.289533] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 240c6599-5988-41da-b054-2385d4f51627 with Priority: HIGHEST for action port [ 636.289885] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-704e5eab-aa44-4493-8c9a-0b24250e7bea taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.290035] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.290108] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.290384] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.290470] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.293470] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-704e5eab-aa44-4493-8c9a-0b24250e7bea taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.294310] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.294310] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.294310] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.294310] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.294523] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.294588] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.294826] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.294995] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.296531] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.296869] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-240c6599-5988-41da-b054-2385d4f51627 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.296869] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-240c6599-5988-41da-b054-2385d4f51627" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.296869] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-240c6599-5988-41da-b054-2385d4f51627" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.297090] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-240c6599-5988-41da-b054-2385d4f51627" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.297150] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('240c6599-5988-41da-b054-2385d4f51627',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.602790] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1a5a07a1-ca36-4e1d-b6a2-e2bc41edb087 [ 636.602790] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.602790] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.602790] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.603032] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.603032] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.603102] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1a5a07a1-ca36-4e1d-b6a2-e2bc41edb087 already deleted. [ 636.603143] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1a5a07a1-ca36-4e1d-b6a2-e2bc41edb087" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.769251] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 in Status: SUCCESS [ 636.769251] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.800545] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-704e5eab-aa44-4493-8c9a-0b24250e7bea taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.800545] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.800545] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.801131] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 240c6599-5988-41da-b054-2385d4f51627 with status ACTIVE [ 636.802073] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.802073] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.802073] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.802073] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.802073] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.802073] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.802073] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.802623] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.802623] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.802623] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.802623] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.802623] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.802915] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.802915] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.802915] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.803019] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 240c6599-5988-41da-b054-2385d4f51627 is going to be updated. [ 636.829314] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.829589] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.829665] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.829852] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.829976] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.830313] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-240c6599-5988-41da-b054-2385d4f51627" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.307411] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.714525] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75e42630-d365-4bb0-89c0-55b0baee0268 in Status: SUCCESS [ 637.715217] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75e42630-d365-4bb0-89c0-55b0baee0268 deletion is rescheduled due to dependency. [ 637.715305] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.814037] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.814037] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.814037] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.814037] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.814037] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.814037] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea is going to be created. [ 637.841626] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.841626] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.841626] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.841901] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.841901] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.852794] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: UNINITIALIZED for 2s [ 638.197870] env[66502]: INFO networking_nsxv3.common.synchronization [None req-c94b08cc-be81-4bd7-a4f1-2a3ec626c9cc None None] Enqueued Resource ID: 3d283179-47a1-44be-a7c0-6f2b7b415063 with Priority: HIGHEST for action port [ 638.198372] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d283179-47a1-44be-a7c0-6f2b7b415063 with Priority: HIGHEST for action port [ 638.199017] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d283179-47a1-44be-a7c0-6f2b7b415063 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.199017] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d283179-47a1-44be-a7c0-6f2b7b415063" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.199017] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d283179-47a1-44be-a7c0-6f2b7b415063" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.199701] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d283179-47a1-44be-a7c0-6f2b7b415063" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.199779] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d283179-47a1-44be-a7c0-6f2b7b415063',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.629246] env[66502]: INFO networking_nsxv3.common.synchronization [None req-640aa632-0047-4baa-ba15-21d6b69108cb None None] Enqueued Resource ID: 6ee225bf-e5a7-4b9c-b209-b18129a7bed5 with Priority: HIGHEST for action port [ 638.630067] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ee225bf-e5a7-4b9c-b209-b18129a7bed5 with Priority: HIGHEST for action port [ 638.630194] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ee225bf-e5a7-4b9c-b209-b18129a7bed5 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.630318] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ee225bf-e5a7-4b9c-b209-b18129a7bed5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.630386] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ee225bf-e5a7-4b9c-b209-b18129a7bed5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.630662] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ee225bf-e5a7-4b9c-b209-b18129a7bed5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.630746] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ee225bf-e5a7-4b9c-b209-b18129a7bed5',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.703359] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3d283179-47a1-44be-a7c0-6f2b7b415063 [ 638.703612] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.703815] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.703867] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.704096] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.704202] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.704320] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3d283179-47a1-44be-a7c0-6f2b7b415063 already deleted. [ 638.704558] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d283179-47a1-44be-a7c0-6f2b7b415063" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.137032] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6ee225bf-e5a7-4b9c-b209-b18129a7bed5 [ 639.137032] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.137032] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.137032] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.137032] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.137032] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.137032] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6ee225bf-e5a7-4b9c-b209-b18129a7bed5 already deleted. [ 639.137032] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ee225bf-e5a7-4b9c-b209-b18129a7bed5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.868840] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: SUCCESS [ 639.868984] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.869142] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.869544] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.869753] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.871139] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.871139] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.871139] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.871139] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.871139] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.871139] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.375067] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-704e5eab-aa44-4493-8c9a-0b24250e7bea taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.375657] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.375657] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.375657] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.375884] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.375952] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.375993] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.377224] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.377224] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.377224] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.377224] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-704e5eab-aa44-4493-8c9a-0b24250e7bea taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.377224] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.377224] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.377224] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.377224] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.377224] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.377224] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.377688] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.377688] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.377688] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.377688] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.379887] env[66502]: INFO networking_nsxv3.common.synchronization [None req-c7565bf4-fd3f-4869-b5a4-e90d57dfb3ea None None] Enqueued Resource ID: 3375b0f7-ff9c-4f48-8624-15fe2f122a4a with Priority: HIGHEST for action port [ 640.380362] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3375b0f7-ff9c-4f48-8624-15fe2f122a4a with Priority: HIGHEST for action port [ 640.380892] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-3375b0f7-ff9c-4f48-8624-15fe2f122a4a taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.381018] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3375b0f7-ff9c-4f48-8624-15fe2f122a4a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.381086] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3375b0f7-ff9c-4f48-8624-15fe2f122a4a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.381311] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3375b0f7-ff9c-4f48-8624-15fe2f122a4a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.381391] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3375b0f7-ff9c-4f48-8624-15fe2f122a4a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.880914] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 704e5eab-aa44-4493-8c9a-0b24250e7bea: rpc.has_security_group_logging(os_id): False [ 640.883628] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3375b0f7-ff9c-4f48-8624-15fe2f122a4a [ 640.883928] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.884456] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.884551] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.884844] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.884926] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.885035] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3375b0f7-ff9c-4f48-8624-15fe2f122a4a already deleted. [ 640.885125] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3375b0f7-ff9c-4f48-8624-15fe2f122a4a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.904391] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.904534] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.904616] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.904965] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.905549] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.905549] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.905549] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.905549] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.905784] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.905784] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.906754] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.906754] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.906754] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.906754] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.906754] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.906754] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.906754] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.906754] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.907165] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.907165] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.907165] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea is going to be created. [ 640.983902] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.984829] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.984829] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.984829] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.985120] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.002653] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: IN_PROGRESS for 2s [ 641.714356] env[66502]: INFO networking_nsxv3.common.synchronization [req-07934ebd-046d-4bb1-bf51-ebe1cf6a3c8a req-9b6b3f21-820c-4349-92cb-158775fbbce0 tempest-ServersAdminNegativeTestJSON-39144073 tempest-ServersAdminNegativeTestJSON-39144073-project-member] Enqueued Resource ID: 881e7189-5d27-4efb-b9a3-71f2b26c3add with Priority: HIGHEST for action security_group_members [ 641.714356] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 881e7189-5d27-4efb-b9a3-71f2b26c3add with Priority: HIGHEST for action security_group_members [ 641.714356] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-881e7189-5d27-4efb-b9a3-71f2b26c3add taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.714356] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.717739] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.718132] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.718376] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.718562] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.718622] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.718797] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.718882] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.718979] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('881e7189-5d27-4efb-b9a3-71f2b26c3add',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.223459] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.223628] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.223675] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.223935] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.224033] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.224235] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.225701] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.225701] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.225701] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.225701] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.225701] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 881e7189-5d27-4efb-b9a3-71f2b26c3add already deleted. [ 642.225701] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.270157] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-670 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.270413] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.270564] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.270862] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.271167] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.271368] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.271517] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.271757] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.271927] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.272172] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 642.272324] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 642.272464] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 642.272586] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 642.272712] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 642.272834] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 642.272981] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 642.293233] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 642.293417] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 642.293549] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 642.293711] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.294029] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-35a0af2f-7fcb-4b3f-9bcb-07daaf95269f taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.294197] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-35a0af2f-7fcb-4b3f-9bcb-07daaf95269f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.294390] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-35a0af2f-7fcb-4b3f-9bcb-07daaf95269f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.294732] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-35a0af2f-7fcb-4b3f-9bcb-07daaf95269f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.294896] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35a0af2f-7fcb-4b3f-9bcb-07daaf95269f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.798021] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.798418] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.798418] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.798766] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.798874] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.799091] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 35a0af2f-7fcb-4b3f-9bcb-07daaf95269f not found, creating... [ 642.799433] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.799559] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.799702] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.799984] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.800066] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.800298] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.800444] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.800572] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.800778] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.800915] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.801543] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 35a0af2f-7fcb-4b3f-9bcb-07daaf95269f is going to be created. [ 642.826225] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.826469] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.826618] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.829628] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.829628] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.829628] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-35a0af2f-7fcb-4b3f-9bcb-07daaf95269f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.022264] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: SUCCESS [ 643.023120] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.026749] env[66502]: INFO networking_nsxv3.common.synchronization [None req-0f02d903-c91c-4f26-9260-8f23980ae0da None None] Enqueued Resource ID: 11bc8db0-2437-4c8c-9fac-e6a05b1d11e2 with Priority: HIGHEST for action port [ 643.027781] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 11bc8db0-2437-4c8c-9fac-e6a05b1d11e2 with Priority: HIGHEST for action port [ 643.027781] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-11bc8db0-2437-4c8c-9fac-e6a05b1d11e2 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.027975] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-11bc8db0-2437-4c8c-9fac-e6a05b1d11e2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.027975] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-11bc8db0-2437-4c8c-9fac-e6a05b1d11e2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.032854] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-11bc8db0-2437-4c8c-9fac-e6a05b1d11e2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.032854] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('11bc8db0-2437-4c8c-9fac-e6a05b1d11e2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.538225] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 11bc8db0-2437-4c8c-9fac-e6a05b1d11e2 [ 643.538458] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.538591] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.538661] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.538885] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.538977] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.539090] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:11bc8db0-2437-4c8c-9fac-e6a05b1d11e2 already deleted. [ 643.539173] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-11bc8db0-2437-4c8c-9fac-e6a05b1d11e2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.578919] env[66502]: INFO networking_nsxv3.common.synchronization [None req-0de983ce-7f20-40a3-9b1a-d07dfa332f34 None None] Enqueued Resource ID: a0b30075-606f-4660-98a6-118779428582 with Priority: HIGHEST for action port [ 643.579525] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0b30075-606f-4660-98a6-118779428582 with Priority: HIGHEST for action port [ 643.579902] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0b30075-606f-4660-98a6-118779428582 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.579985] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0b30075-606f-4660-98a6-118779428582" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.580068] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0b30075-606f-4660-98a6-118779428582" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.580620] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0b30075-606f-4660-98a6-118779428582" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.580713] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0b30075-606f-4660-98a6-118779428582',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.646851] env[66502]: INFO networking_nsxv3.common.synchronization [req-07934ebd-046d-4bb1-bf51-ebe1cf6a3c8a req-13ff81ec-5795-40f1-82d1-0cedec18e802 service nova] Enqueued Resource ID: 881e7189-5d27-4efb-b9a3-71f2b26c3add with Priority: HIGHEST for action security_group_rules [ 643.647080] env[66502]: INFO networking_nsxv3.common.synchronization [req-07934ebd-046d-4bb1-bf51-ebe1cf6a3c8a req-13ff81ec-5795-40f1-82d1-0cedec18e802 service nova] Enqueued Resource ID: 881e7189-5d27-4efb-b9a3-71f2b26c3add with Priority: HIGHEST for action security_group_members [ 643.647219] env[66502]: INFO networking_nsxv3.common.synchronization [req-07934ebd-046d-4bb1-bf51-ebe1cf6a3c8a req-13ff81ec-5795-40f1-82d1-0cedec18e802 service nova] Enqueued Resource ID: 35a0af2f-7fcb-4b3f-9bcb-07daaf95269f with Priority: HIGHEST for action port [ 643.647780] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 881e7189-5d27-4efb-b9a3-71f2b26c3add with Priority: HIGHEST for action security_group_rules [ 643.647928] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 881e7189-5d27-4efb-b9a3-71f2b26c3add with Priority: HIGHEST for action security_group_members [ 643.648331] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35a0af2f-7fcb-4b3f-9bcb-07daaf95269f with Priority: HIGHEST for action port [ 643.648597] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-881e7189-5d27-4efb-b9a3-71f2b26c3add taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.649120] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.649120] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.649370] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.649508] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('881e7189-5d27-4efb-b9a3-71f2b26c3add',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.650451] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-881e7189-5d27-4efb-b9a3-71f2b26c3add taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.650644] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.650805] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.651313] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.652180] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.652378] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.652449] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.652633] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.652743] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.652843] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('881e7189-5d27-4efb-b9a3-71f2b26c3add',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.654690] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-35a0af2f-7fcb-4b3f-9bcb-07daaf95269f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.655321] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35a0af2f-7fcb-4b3f-9bcb-07daaf95269f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.655425] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35a0af2f-7fcb-4b3f-9bcb-07daaf95269f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.655708] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35a0af2f-7fcb-4b3f-9bcb-07daaf95269f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.655798] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35a0af2f-7fcb-4b3f-9bcb-07daaf95269f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.958771] env[66502]: INFO networking_nsxv3.common.synchronization [req-9c3ca9f3-8b88-4460-a8df-1393dda37039 req-457fbb3a-a9b7-4bf1-aa32-fb34028b4a85 tempest-ImagesNegativeTestJSON-744524934 tempest-ImagesNegativeTestJSON-744524934-project-member] Enqueued Resource ID: 25ed9582-5ba1-4260-bd41-77518f4c6d14 with Priority: HIGHEST for action security_group_members [ 643.958771] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25ed9582-5ba1-4260-bd41-77518f4c6d14 with Priority: HIGHEST for action security_group_members [ 643.959182] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-25ed9582-5ba1-4260-bd41-77518f4c6d14 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.960746] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-25ed9582-5ba1-4260-bd41-77518f4c6d14" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.960746] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-25ed9582-5ba1-4260-bd41-77518f4c6d14" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.960924] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-25ed9582-5ba1-4260-bd41-77518f4c6d14" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.961094] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.961227] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.961334] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.961581] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.961728] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.961886] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('25ed9582-5ba1-4260-bd41-77518f4c6d14',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.082895] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a0b30075-606f-4660-98a6-118779428582 [ 644.084384] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.084481] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.084516] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.084724] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.084832] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.085100] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a0b30075-606f-4660-98a6-118779428582 already deleted. [ 644.085100] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0b30075-606f-4660-98a6-118779428582" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.160774] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-881e7189-5d27-4efb-b9a3-71f2b26c3add taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.160941] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.161191] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('881e7189-5d27-4efb-b9a3-71f2b26c3add',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.162410] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 35a0af2f-7fcb-4b3f-9bcb-07daaf95269f with status ACTIVE [ 644.162910] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.163065] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.165918] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.166209] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.166308] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.166512] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.166626] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.166688] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.166862] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.166939] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.167324] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.167446] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.167510] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.167664] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.167734] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.167817] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 35a0af2f-7fcb-4b3f-9bcb-07daaf95269f is going to be updated. [ 644.195228] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.195548] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.195548] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.195806] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.195806] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.196076] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35a0af2f-7fcb-4b3f-9bcb-07daaf95269f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.411829] env[66502]: INFO networking_nsxv3.common.synchronization [None req-2ed0715d-9a82-42f5-a4f6-fc806503b2d9 tempest-ServerActionsTestJSON-2133613622 tempest-ServerActionsTestJSON-2133613622-project-member] Enqueued Resource ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 with Priority: HIGHEST for action security_group_rules [ 644.412289] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 with Priority: HIGHEST for action security_group_rules [ 644.412623] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.412769] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.412769] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.413306] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.413306] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ab1d50c-f5a6-4aaf-829b-d0cfdf164722',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.469639] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.469639] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.469639] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.469639] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.469639] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.469639] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.469639] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.469639] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.469639] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.469639] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.469639] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25ed9582-5ba1-4260-bd41-77518f4c6d14 is going to be updated. [ 644.504849] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.505073] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.505149] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.505336] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.505465] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.515529] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25ed9582-5ba1-4260-bd41-77518f4c6d14 in Status: IN_PROGRESS for 2s [ 644.672463] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('881e7189-5d27-4efb-b9a3-71f2b26c3add',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.774185] env[66502]: INFO networking_nsxv3.common.synchronization [None req-2a5b3c21-4568-4b08-82b2-1613a7e7c74b None None] Enqueued Resource ID: 166d719a-26b6-4c25-ba84-82f82c42576b with Priority: HIGHEST for action port [ 644.775352] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 166d719a-26b6-4c25-ba84-82f82c42576b with Priority: HIGHEST for action port [ 644.775793] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-166d719a-26b6-4c25-ba84-82f82c42576b taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.775952] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-166d719a-26b6-4c25-ba84-82f82c42576b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.776051] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-166d719a-26b6-4c25-ba84-82f82c42576b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.776444] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-166d719a-26b6-4c25-ba84-82f82c42576b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.776537] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('166d719a-26b6-4c25-ba84-82f82c42576b',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.942055] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.942319] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.942384] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.942578] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.942819] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.942819] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 already deleted. [ 644.942970] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.001513] env[66502]: INFO networking_nsxv3.common.synchronization [None req-56aa412a-67ba-4a31-87f8-d913467ca896 tempest-ServerActionsTestJSON-2133613622 tempest-ServerActionsTestJSON-2133613622-project-member] Enqueued Resource ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 with Priority: HIGHEST for action security_group_rules [ 645.002524] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 with Priority: HIGHEST for action security_group_rules [ 645.003036] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.003036] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.003221] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.003893] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.003893] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ab1d50c-f5a6-4aaf-829b-d0cfdf164722',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.058036] env[66502]: INFO networking_nsxv3.common.synchronization [None req-c03cbe5b-ef85-425d-b72f-e8ea092ec4f1 None None] Enqueued Resource ID: 14c3086b-20be-41e9-875f-9dafd40335b6 with Priority: HIGHEST for action port [ 645.058036] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14c3086b-20be-41e9-875f-9dafd40335b6 with Priority: HIGHEST for action port [ 645.058545] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-14c3086b-20be-41e9-875f-9dafd40335b6 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.059132] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14c3086b-20be-41e9-875f-9dafd40335b6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.059132] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14c3086b-20be-41e9-875f-9dafd40335b6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.059132] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14c3086b-20be-41e9-875f-9dafd40335b6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.059132] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14c3086b-20be-41e9-875f-9dafd40335b6',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.175049] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.175357] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.175693] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.175997] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.176189] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.176189] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 881e7189-5d27-4efb-b9a3-71f2b26c3add is going to be created. [ 645.215035] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.215035] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.215035] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.215035] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.215035] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.229145] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 881e7189-5d27-4efb-b9a3-71f2b26c3add in Status: UNINITIALIZED for 2s [ 645.279281] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 166d719a-26b6-4c25-ba84-82f82c42576b [ 645.279644] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.279836] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.279939] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.280271] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.280414] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.280579] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:166d719a-26b6-4c25-ba84-82f82c42576b already deleted. [ 645.280703] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-166d719a-26b6-4c25-ba84-82f82c42576b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.535747] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.535747] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.535747] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.535747] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.535747] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.535747] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 already deleted. [ 645.535747] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.563635] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 14c3086b-20be-41e9-875f-9dafd40335b6 [ 645.563867] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.564011] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.564088] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.564303] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.564388] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.564487] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:14c3086b-20be-41e9-875f-9dafd40335b6 already deleted. [ 645.564569] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14c3086b-20be-41e9-875f-9dafd40335b6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.526194] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 25ed9582-5ba1-4260-bd41-77518f4c6d14 in Status: SUCCESS [ 646.526517] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 25ed9582-5ba1-4260-bd41-77518f4c6d14 deletion is rescheduled due to dependency. [ 646.526517] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-25ed9582-5ba1-4260-bd41-77518f4c6d14" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.970128] env[66502]: INFO networking_nsxv3.common.synchronization [None req-ddba71bb-342e-4549-9050-589a485f80b2 None None] Enqueued Resource ID: ddbda6fc-962f-4ccf-a99a-1bc31b320b5b with Priority: HIGHEST for action port [ 646.970128] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddbda6fc-962f-4ccf-a99a-1bc31b320b5b with Priority: HIGHEST for action port [ 646.970128] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-ddbda6fc-962f-4ccf-a99a-1bc31b320b5b taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.970128] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ddbda6fc-962f-4ccf-a99a-1bc31b320b5b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.970128] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ddbda6fc-962f-4ccf-a99a-1bc31b320b5b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.970128] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ddbda6fc-962f-4ccf-a99a-1bc31b320b5b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.970128] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ddbda6fc-962f-4ccf-a99a-1bc31b320b5b',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.243260] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 881e7189-5d27-4efb-b9a3-71f2b26c3add in Status: SUCCESS [ 647.243260] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.243260] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.243260] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.243260] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.243260] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.243260] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.243260] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.243260] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.243260] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.243260] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('881e7189-5d27-4efb-b9a3-71f2b26c3add',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.473044] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ddbda6fc-962f-4ccf-a99a-1bc31b320b5b [ 647.473290] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.473426] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.473496] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.473728] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.473816] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.476434] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ddbda6fc-962f-4ccf-a99a-1bc31b320b5b already deleted. [ 647.476562] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ddbda6fc-962f-4ccf-a99a-1bc31b320b5b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.490503] env[66502]: INFO networking_nsxv3.common.synchronization [req-3c332ed2-4ea4-4060-b451-e37bb0f45c0e req-f6d8a82f-5d4d-49b9-9458-619852e683c6 tempest-ServersWithSpecificFlavorTestJSON-713469048 tempest-ServersWithSpecificFlavorTestJSON-713469048-project-member] Enqueued Resource ID: 7421254e-fac2-4232-97e1-1f7373688543 with Priority: HIGHEST for action security_group_members [ 647.490503] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7421254e-fac2-4232-97e1-1f7373688543 with Priority: HIGHEST for action security_group_members [ 647.490503] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-7421254e-fac2-4232-97e1-1f7373688543 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.490503] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.490503] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.490503] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.490503] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.490503] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.491636] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.491829] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.491924] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.492565] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7421254e-fac2-4232-97e1-1f7373688543',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.749855] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-881e7189-5d27-4efb-b9a3-71f2b26c3add taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.749855] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.749855] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.749855] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.749855] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.749855] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.749855] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.749855] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.749855] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.749855] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.749855] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-881e7189-5d27-4efb-b9a3-71f2b26c3add taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.749855] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.749855] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.749855] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.749855] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.749855] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.752263] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.752263] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.752263] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.752263] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.752263] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('881e7189-5d27-4efb-b9a3-71f2b26c3add',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.969420] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-583 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.969420] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-583" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.969420] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-583" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.969420] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-583" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.969420] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.969420] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.969420] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.969420] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.969420] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.969420] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 647.969889] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 647.969889] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 647.969889] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 647.969889] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 647.969889] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 647.970086] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 647.993022] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 647.993022] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 647.993022] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 647.993022] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-583" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.993022] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-1bd7a923-f3d6-47e5-9223-27081ec225a9 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.993022] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-1bd7a923-f3d6-47e5-9223-27081ec225a9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.993022] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-1bd7a923-f3d6-47e5-9223-27081ec225a9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.993022] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-1bd7a923-f3d6-47e5-9223-27081ec225a9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.993022] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1bd7a923-f3d6-47e5-9223-27081ec225a9',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.995503] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.996116] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.996285] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.997746] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.997746] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.997746] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.997746] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.997746] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.997746] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.997746] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.997746] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7421254e-fac2-4232-97e1-1f7373688543 already deleted. [ 647.997746] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.253599] env[66502]: INFO networking_nsxv3.common.synchronization [None req-1954972b-9d09-4324-81d7-fa1256c79daa None None] Enqueued Resource ID: 7e20fa71-dc29-4a7b-bdf5-9e46760bd90c with Priority: HIGHEST for action port [ 648.254236] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e20fa71-dc29-4a7b-bdf5-9e46760bd90c with Priority: HIGHEST for action port [ 648.254480] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 881e7189-5d27-4efb-b9a3-71f2b26c3add: rpc.has_security_group_logging(os_id): False [ 648.257830] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-7e20fa71-dc29-4a7b-bdf5-9e46760bd90c taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.258020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7e20fa71-dc29-4a7b-bdf5-9e46760bd90c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.258202] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7e20fa71-dc29-4a7b-bdf5-9e46760bd90c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.258501] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7e20fa71-dc29-4a7b-bdf5-9e46760bd90c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.258619] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7e20fa71-dc29-4a7b-bdf5-9e46760bd90c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.278132] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.278292] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.278348] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.278564] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.278655] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.278957] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.279108] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.279108] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.279246] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.279297] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.279461] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.279556] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.279618] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.279758] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.279831] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.280773] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.280988] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.281116] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.281296] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.281397] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.282058] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 881e7189-5d27-4efb-b9a3-71f2b26c3add is going to be created. [ 648.350643] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.350643] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.350643] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.350643] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.350643] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.371213] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 881e7189-5d27-4efb-b9a3-71f2b26c3add in Status: IN_PROGRESS for 2s [ 648.499222] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.499222] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.499222] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.499222] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.499222] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.499222] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 1bd7a923-f3d6-47e5-9223-27081ec225a9 not found, creating... [ 648.499222] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.499222] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.499222] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.499222] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.499222] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.499794] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.499794] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.499794] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.499794] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.499794] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.499794] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 1bd7a923-f3d6-47e5-9223-27081ec225a9 is going to be created. [ 648.531521] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.531521] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.531521] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.531521] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.531521] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.531521] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-1bd7a923-f3d6-47e5-9223-27081ec225a9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.760917] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7e20fa71-dc29-4a7b-bdf5-9e46760bd90c [ 648.761220] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.761353] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.761463] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.761726] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.762021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.762147] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7e20fa71-dc29-4a7b-bdf5-9e46760bd90c already deleted. [ 648.762928] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7e20fa71-dc29-4a7b-bdf5-9e46760bd90c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.287904] env[66502]: INFO networking_nsxv3.common.synchronization [req-3c332ed2-4ea4-4060-b451-e37bb0f45c0e req-aeb4c3c5-7b81-4283-adc2-987ad317448b service nova] Enqueued Resource ID: 7421254e-fac2-4232-97e1-1f7373688543 with Priority: HIGHEST for action security_group_rules [ 649.288132] env[66502]: INFO networking_nsxv3.common.synchronization [req-3c332ed2-4ea4-4060-b451-e37bb0f45c0e req-aeb4c3c5-7b81-4283-adc2-987ad317448b service nova] Enqueued Resource ID: 7421254e-fac2-4232-97e1-1f7373688543 with Priority: HIGHEST for action security_group_members [ 649.288607] env[66502]: INFO networking_nsxv3.common.synchronization [req-3c332ed2-4ea4-4060-b451-e37bb0f45c0e req-aeb4c3c5-7b81-4283-adc2-987ad317448b service nova] Enqueued Resource ID: 1bd7a923-f3d6-47e5-9223-27081ec225a9 with Priority: HIGHEST for action port [ 649.288607] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7421254e-fac2-4232-97e1-1f7373688543 with Priority: HIGHEST for action security_group_rules [ 649.288607] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7421254e-fac2-4232-97e1-1f7373688543 with Priority: HIGHEST for action security_group_members [ 649.288740] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bd7a923-f3d6-47e5-9223-27081ec225a9 with Priority: HIGHEST for action port [ 649.289597] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7421254e-fac2-4232-97e1-1f7373688543 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.289728] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.289799] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.290016] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.290106] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7421254e-fac2-4232-97e1-1f7373688543',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.290950] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-7421254e-fac2-4232-97e1-1f7373688543 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.291087] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.291134] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.291403] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.292071] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.292071] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.292071] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.292347] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.292471] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.292471] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7421254e-fac2-4232-97e1-1f7373688543',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.294695] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-1bd7a923-f3d6-47e5-9223-27081ec225a9 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.294695] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1bd7a923-f3d6-47e5-9223-27081ec225a9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.294695] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1bd7a923-f3d6-47e5-9223-27081ec225a9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.294695] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1bd7a923-f3d6-47e5-9223-27081ec225a9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.294695] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1bd7a923-f3d6-47e5-9223-27081ec225a9',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.794501] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7421254e-fac2-4232-97e1-1f7373688543',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.796514] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1bd7a923-f3d6-47e5-9223-27081ec225a9 with status ACTIVE [ 649.797308] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.797308] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.798276] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.798638] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.801834] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.801834] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.801834] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.801834] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.801834] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.801834] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.801834] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.801834] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.801834] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.801834] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.802458] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.802897] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1bd7a923-f3d6-47e5-9223-27081ec225a9 is going to be updated. [ 649.804277] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-7421254e-fac2-4232-97e1-1f7373688543 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.804901] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.828112] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.828347] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.828347] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.828781] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.828781] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.828898] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1bd7a923-f3d6-47e5-9223-27081ec225a9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.937108] env[66502]: INFO networking_nsxv3.common.synchronization [None req-49cb5af0-3251-4753-b308-d1761766ecac None None] Enqueued Resource ID: 3f7f74e2-df7e-40b2-bc03-65c3a52b2303 with Priority: HIGHEST for action port [ 649.938657] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f7f74e2-df7e-40b2-bc03-65c3a52b2303 with Priority: HIGHEST for action port [ 649.939260] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f7f74e2-df7e-40b2-bc03-65c3a52b2303 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.939442] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f7f74e2-df7e-40b2-bc03-65c3a52b2303" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.939790] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f7f74e2-df7e-40b2-bc03-65c3a52b2303" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.940159] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f7f74e2-df7e-40b2-bc03-65c3a52b2303" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.940274] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f7f74e2-df7e-40b2-bc03-65c3a52b2303',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.223648] env[66502]: INFO networking_nsxv3.common.synchronization [None req-c5d64f2a-0280-4f54-aafa-38b643aa225f None None] Enqueued Resource ID: 07c6cc44-00c9-453e-a8cd-baa48affa9db with Priority: HIGHEST for action port [ 650.224174] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07c6cc44-00c9-453e-a8cd-baa48affa9db with Priority: HIGHEST for action port [ 650.224594] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-07c6cc44-00c9-453e-a8cd-baa48affa9db taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.224792] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07c6cc44-00c9-453e-a8cd-baa48affa9db" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.224792] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07c6cc44-00c9-453e-a8cd-baa48affa9db" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.225073] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07c6cc44-00c9-453e-a8cd-baa48affa9db" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.225178] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07c6cc44-00c9-453e-a8cd-baa48affa9db',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.297644] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7421254e-fac2-4232-97e1-1f7373688543',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 650.387766] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 881e7189-5d27-4efb-b9a3-71f2b26c3add in Status: SUCCESS [ 650.388472] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.443169] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3f7f74e2-df7e-40b2-bc03-65c3a52b2303 [ 650.443396] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.443536] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.443606] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.444350] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.444350] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.444350] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3f7f74e2-df7e-40b2-bc03-65c3a52b2303 already deleted. [ 650.444350] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f7f74e2-df7e-40b2-bc03-65c3a52b2303" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.728286] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 07c6cc44-00c9-453e-a8cd-baa48affa9db [ 650.728286] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.728286] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.728286] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.728286] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.728286] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.728286] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:07c6cc44-00c9-453e-a8cd-baa48affa9db already deleted. [ 650.728286] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07c6cc44-00c9-453e-a8cd-baa48affa9db" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.800322] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.800735] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.800735] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.800811] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.800846] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.800940] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7421254e-fac2-4232-97e1-1f7373688543 is going to be created. [ 650.838104] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.838104] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.838104] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.838356] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.839428] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.854017] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7421254e-fac2-4232-97e1-1f7373688543 in Status: UNINITIALIZED for 2s [ 651.076020] env[66502]: INFO networking_nsxv3.common.synchronization [None req-14360f29-e241-41c9-bed4-7b1a3ca1ba46 None None] Enqueued Resource ID: ec43178b-ffc7-4ed8-970d-9ae4527be078 with Priority: HIGHEST for action port [ 651.076020] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec43178b-ffc7-4ed8-970d-9ae4527be078 with Priority: HIGHEST for action port [ 651.076020] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec43178b-ffc7-4ed8-970d-9ae4527be078 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.076020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec43178b-ffc7-4ed8-970d-9ae4527be078" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.076020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec43178b-ffc7-4ed8-970d-9ae4527be078" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.076020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec43178b-ffc7-4ed8-970d-9ae4527be078" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.076020] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec43178b-ffc7-4ed8-970d-9ae4527be078',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.157963] env[66502]: INFO networking_nsxv3.common.synchronization [None req-9b67634e-d353-4c1a-9f17-10d910eae994 None None] Enqueued Resource ID: e7614885-c15c-46bd-b4ad-18da59ced188 with Priority: HIGHEST for action port [ 651.158162] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e7614885-c15c-46bd-b4ad-18da59ced188 with Priority: HIGHEST for action port [ 651.158713] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-e7614885-c15c-46bd-b4ad-18da59ced188 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.158844] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e7614885-c15c-46bd-b4ad-18da59ced188" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.158914] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e7614885-c15c-46bd-b4ad-18da59ced188" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.161198] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e7614885-c15c-46bd-b4ad-18da59ced188" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.161198] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e7614885-c15c-46bd-b4ad-18da59ced188',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.579880] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ec43178b-ffc7-4ed8-970d-9ae4527be078 [ 651.579880] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.579880] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.579880] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.579880] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.579880] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.579880] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ec43178b-ffc7-4ed8-970d-9ae4527be078 already deleted. [ 651.579880] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec43178b-ffc7-4ed8-970d-9ae4527be078" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.670089] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e7614885-c15c-46bd-b4ad-18da59ced188 [ 651.670089] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.670089] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.670089] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.670089] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.670089] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.670089] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e7614885-c15c-46bd-b4ad-18da59ced188 already deleted. [ 651.670089] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e7614885-c15c-46bd-b4ad-18da59ced188" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.866678] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7421254e-fac2-4232-97e1-1f7373688543 in Status: SUCCESS [ 652.867935] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.868113] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.868377] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.868619] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.868769] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.868852] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.869067] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.869164] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.869301] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.869429] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7421254e-fac2-4232-97e1-1f7373688543',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.967741] env[66502]: INFO networking_nsxv3.common.synchronization [req-6b8276e3-e032-4ab0-992a-45ecebd4c3a8 req-e274e5da-9b1a-4041-83ac-97b1394a2bc3 tempest-ServerMetadataTestJSON-68704275 tempest-ServerMetadataTestJSON-68704275-project-member] Enqueued Resource ID: b1dbab98-9c58-424b-aadb-07860f808828 with Priority: HIGHEST for action security_group_members [ 652.968295] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1dbab98-9c58-424b-aadb-07860f808828 with Priority: HIGHEST for action security_group_members [ 652.968606] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1dbab98-9c58-424b-aadb-07860f808828 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.968729] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1dbab98-9c58-424b-aadb-07860f808828" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.968796] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1dbab98-9c58-424b-aadb-07860f808828" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.969432] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1dbab98-9c58-424b-aadb-07860f808828" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.970595] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.971653] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.971653] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.971653] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.971815] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.972376] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1dbab98-9c58-424b-aadb-07860f808828',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.358195] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-729 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.358649] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-729" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.358649] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-729" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.358876] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-729" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.359177] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.359445] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.359588] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.360280] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.360379] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.360659] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 653.360730] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 653.361098] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 653.361098] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 653.361098] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 653.361245] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 653.361288] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 653.373031] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7421254e-fac2-4232-97e1-1f7373688543',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.386106] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 653.386106] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 653.386106] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 653.386106] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-729" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.386404] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-14eb9662-3c8d-48cb-a9ea-c9746d476088 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.386521] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-14eb9662-3c8d-48cb-a9ea-c9746d476088" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.387629] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-14eb9662-3c8d-48cb-a9ea-c9746d476088" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.387629] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-14eb9662-3c8d-48cb-a9ea-c9746d476088" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.388328] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14eb9662-3c8d-48cb-a9ea-c9746d476088',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.477393] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.478541] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.478611] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.479290] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.479290] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.479290] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.479290] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.479548] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.479635] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.479718] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.479808] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1dbab98-9c58-424b-aadb-07860f808828 already deleted. [ 653.479890] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1dbab98-9c58-424b-aadb-07860f808828" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.505089] env[66502]: INFO networking_nsxv3.common.synchronization [None req-e46dbfb6-5b36-4c71-9037-4a222bf2e537 None None] Enqueued Resource ID: 0f33e2c6-85ee-420d-9d85-2ee3c89ba4a6 with Priority: HIGHEST for action port [ 653.506016] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f33e2c6-85ee-420d-9d85-2ee3c89ba4a6 with Priority: HIGHEST for action port [ 653.506371] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f33e2c6-85ee-420d-9d85-2ee3c89ba4a6 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.506601] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f33e2c6-85ee-420d-9d85-2ee3c89ba4a6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.507785] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f33e2c6-85ee-420d-9d85-2ee3c89ba4a6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.507785] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f33e2c6-85ee-420d-9d85-2ee3c89ba4a6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.507785] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f33e2c6-85ee-420d-9d85-2ee3c89ba4a6',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.875957] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7421254e-fac2-4232-97e1-1f7373688543: rpc.has_security_group_logging(os_id): False [ 653.892716] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.892907] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.893031] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.893319] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.893479] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.893597] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port 14eb9662-3c8d-48cb-a9ea-c9746d476088 not found, creating... [ 653.893849] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.893990] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.894115] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.894328] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.894455] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.894728] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.894904] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.895033] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.895246] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.895374] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.895504] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: 14eb9662-3c8d-48cb-a9ea-c9746d476088 is going to be created. [ 653.911406] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.911566] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.911636] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.911919] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.911954] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.912226] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.912378] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.912410] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.912703] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.912809] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.912932] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7421254e-fac2-4232-97e1-1f7373688543 is going to be created. [ 653.927774] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.928103] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.928310] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.928699] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.929017] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.929330] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-14eb9662-3c8d-48cb-a9ea-c9746d476088" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.011226] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0f33e2c6-85ee-420d-9d85-2ee3c89ba4a6 [ 654.011450] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.011550] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.011747] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.011917] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.012032] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.012142] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0f33e2c6-85ee-420d-9d85-2ee3c89ba4a6 already deleted. [ 654.012235] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f33e2c6-85ee-420d-9d85-2ee3c89ba4a6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.059163] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.059361] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.059504] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.059812] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.060097] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.091855] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7421254e-fac2-4232-97e1-1f7373688543 in Status: IN_PROGRESS for 2s [ 654.168670] env[66502]: INFO networking_nsxv3.common.synchronization [None req-7f7bb9a5-be67-4bfb-af14-b282099cef6e None None] Enqueued Resource ID: e62cb89a-5013-44c9-bc09-902fcf00f3f6 with Priority: HIGHEST for action port [ 654.169020] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e62cb89a-5013-44c9-bc09-902fcf00f3f6 with Priority: HIGHEST for action port [ 654.169339] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-e62cb89a-5013-44c9-bc09-902fcf00f3f6 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.169464] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e62cb89a-5013-44c9-bc09-902fcf00f3f6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.169534] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e62cb89a-5013-44c9-bc09-902fcf00f3f6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.169823] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e62cb89a-5013-44c9-bc09-902fcf00f3f6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.169939] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e62cb89a-5013-44c9-bc09-902fcf00f3f6',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.664402] env[66502]: INFO networking_nsxv3.common.synchronization [req-6b8276e3-e032-4ab0-992a-45ecebd4c3a8 req-9422fb30-b14b-43e3-ad7c-d3f80bbcd001 service nova] Enqueued Resource ID: b1dbab98-9c58-424b-aadb-07860f808828 with Priority: HIGHEST for action security_group_rules [ 654.664571] env[66502]: INFO networking_nsxv3.common.synchronization [req-6b8276e3-e032-4ab0-992a-45ecebd4c3a8 req-9422fb30-b14b-43e3-ad7c-d3f80bbcd001 service nova] Enqueued Resource ID: b1dbab98-9c58-424b-aadb-07860f808828 with Priority: HIGHEST for action security_group_members [ 654.664712] env[66502]: INFO networking_nsxv3.common.synchronization [req-6b8276e3-e032-4ab0-992a-45ecebd4c3a8 req-9422fb30-b14b-43e3-ad7c-d3f80bbcd001 service nova] Enqueued Resource ID: 14eb9662-3c8d-48cb-a9ea-c9746d476088 with Priority: HIGHEST for action port [ 654.665469] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1dbab98-9c58-424b-aadb-07860f808828 with Priority: HIGHEST for action security_group_rules [ 654.665469] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1dbab98-9c58-424b-aadb-07860f808828 with Priority: HIGHEST for action security_group_members [ 654.665575] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14eb9662-3c8d-48cb-a9ea-c9746d476088 with Priority: HIGHEST for action port [ 654.665818] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1dbab98-9c58-424b-aadb-07860f808828 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.665983] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1dbab98-9c58-424b-aadb-07860f808828" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.666220] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1dbab98-9c58-424b-aadb-07860f808828" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.666603] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1dbab98-9c58-424b-aadb-07860f808828" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.669265] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1dbab98-9c58-424b-aadb-07860f808828',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.672493] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1dbab98-9c58-424b-aadb-07860f808828 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.672493] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1dbab98-9c58-424b-aadb-07860f808828" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.672493] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1dbab98-9c58-424b-aadb-07860f808828" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.672493] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1dbab98-9c58-424b-aadb-07860f808828" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.672493] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.672493] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.672493] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.672493] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.672858] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.672858] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1dbab98-9c58-424b-aadb-07860f808828',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.677223] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-14eb9662-3c8d-48cb-a9ea-c9746d476088 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.677223] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-14eb9662-3c8d-48cb-a9ea-c9746d476088" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.677223] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-14eb9662-3c8d-48cb-a9ea-c9746d476088" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.677223] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-14eb9662-3c8d-48cb-a9ea-c9746d476088" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.677223] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('14eb9662-3c8d-48cb-a9ea-c9746d476088',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.679815] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e62cb89a-5013-44c9-bc09-902fcf00f3f6 [ 654.682035] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.682035] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.682035] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.682035] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.682035] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.682035] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e62cb89a-5013-44c9-bc09-902fcf00f3f6 already deleted. [ 654.682035] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e62cb89a-5013-44c9-bc09-902fcf00f3f6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.808263] env[66502]: INFO networking_nsxv3.common.synchronization [None req-ede4e20b-b9e0-4f5f-b067-dae418eb18f8 tempest-ServersTestManualDisk-1208375570 tempest-ServersTestManualDisk-1208375570-project-member] Enqueued Resource ID: 2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49 with Priority: HIGHEST for action security_group_rules [ 654.808808] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49 with Priority: HIGHEST for action security_group_rules [ 654.809114] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.809384] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.809384] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.809538] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.809620] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.995904] env[66502]: INFO networking_nsxv3.common.synchronization [None req-8fd3c2fd-3f8d-4a2f-bd88-65eeb52e26a3 tempest-ServersV294TestFqdnHostnames-23965797 tempest-ServersV294TestFqdnHostnames-23965797-project-member] Enqueued Resource ID: c7d21481-83aa-4bac-bea4-1030ed0a857b with Priority: HIGHEST for action security_group_rules [ 654.997694] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7d21481-83aa-4bac-bea4-1030ed0a857b with Priority: HIGHEST for action security_group_rules [ 654.997694] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7d21481-83aa-4bac-bea4-1030ed0a857b taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.997694] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7d21481-83aa-4bac-bea4-1030ed0a857b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.997694] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7d21481-83aa-4bac-bea4-1030ed0a857b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.997694] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7d21481-83aa-4bac-bea4-1030ed0a857b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.997694] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7d21481-83aa-4bac-bea4-1030ed0a857b',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.014474] env[66502]: INFO networking_nsxv3.common.synchronization [None req-763baf5e-1a3e-4387-9738-5dedb172a36b tempest-ServersTestManualDisk-1208375570 tempest-ServersTestManualDisk-1208375570-project-member] Enqueued Resource ID: 2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49 with Priority: HIGHEST for action security_group_rules [ 655.015401] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49 with Priority: HIGHEST for action security_group_rules [ 655.015708] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.015810] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.179734] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1dbab98-9c58-424b-aadb-07860f808828 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.179917] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1dbab98-9c58-424b-aadb-07860f808828" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.180075] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b1dbab98-9c58-424b-aadb-07860f808828',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.181961] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 14eb9662-3c8d-48cb-a9ea-c9746d476088 with status ACTIVE [ 655.182247] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.182386] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.182386] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.182799] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.182799] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.182942] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.183172] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.183172] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.183361] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.183361] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.183541] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.183690] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.183753] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.183902] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.183978] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.184073] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 14eb9662-3c8d-48cb-a9ea-c9746d476088 is going to be updated. [ 655.201642] env[66502]: INFO networking_nsxv3.common.synchronization [None req-7583b105-6023-4495-ba14-f9e9a3ddbd99 tempest-ServersV294TestFqdnHostnames-23965797 tempest-ServersV294TestFqdnHostnames-23965797-project-member] Enqueued Resource ID: c7d21481-83aa-4bac-bea4-1030ed0a857b with Priority: HIGHEST for action security_group_rules [ 655.202412] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7d21481-83aa-4bac-bea4-1030ed0a857b with Priority: HIGHEST for action security_group_rules [ 655.202976] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7d21481-83aa-4bac-bea4-1030ed0a857b taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.202976] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7d21481-83aa-4bac-bea4-1030ed0a857b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.210992] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.211930] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.211930] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.211930] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.211930] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.211930] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-14eb9662-3c8d-48cb-a9ea-c9746d476088" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.344173] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.344402] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.344402] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.344716] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.344916] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.344996] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49 already deleted. [ 655.345436] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.345436] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.345567] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.345567] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.518292] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.518292] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.518292] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.518557] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.518557] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.518557] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7d21481-83aa-4bac-bea4-1030ed0a857b already deleted. [ 655.518694] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7d21481-83aa-4bac-bea4-1030ed0a857b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.518799] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7d21481-83aa-4bac-bea4-1030ed0a857b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.518983] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7d21481-83aa-4bac-bea4-1030ed0a857b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.519082] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7d21481-83aa-4bac-bea4-1030ed0a857b',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.683119] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b1dbab98-9c58-424b-aadb-07860f808828',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.875357] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.875520] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.875595] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.875817] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.875950] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.876051] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49 already deleted. [ 655.876144] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.046494] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.046494] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.046494] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.046494] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.046494] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.046494] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7d21481-83aa-4bac-bea4-1030ed0a857b already deleted. [ 656.046494] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7d21481-83aa-4bac-bea4-1030ed0a857b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.108121] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7421254e-fac2-4232-97e1-1f7373688543 in Status: SUCCESS [ 656.108362] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.187991] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.187991] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.187991] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.188168] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.188168] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.188229] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1dbab98-9c58-424b-aadb-07860f808828 is going to be created. [ 656.215583] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.217030] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.217162] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.217424] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.217596] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.229295] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1dbab98-9c58-424b-aadb-07860f808828 in Status: UNINITIALIZED for 2s [ 656.508434] env[66502]: INFO networking_nsxv3.common.synchronization [req-92ab7ec9-8af0-4a42-bacf-13ab9ef2ccee req-bd4d3ca2-d40f-4f91-a46c-cc7be147664d tempest-ServerPasswordTestJSON-1011645008 tempest-ServerPasswordTestJSON-1011645008-project-member] Enqueued Resource ID: 96893623-1913-4658-8960-6e93015a062e with Priority: HIGHEST for action security_group_members [ 656.508969] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96893623-1913-4658-8960-6e93015a062e with Priority: HIGHEST for action security_group_members [ 656.509279] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-96893623-1913-4658-8960-6e93015a062e taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.509407] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-96893623-1913-4658-8960-6e93015a062e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.509532] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-96893623-1913-4658-8960-6e93015a062e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.509728] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-96893623-1913-4658-8960-6e93015a062e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.509945] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.510080] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.510434] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.510619] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.510712] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.510808] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('96893623-1913-4658-8960-6e93015a062e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 656.517668] env[66502]: INFO networking_nsxv3.common.synchronization [req-a058199f-80cd-4eb5-882e-3ae106b9d55f req-8901c807-0fcf-40fd-89dd-37639ccb80fb tempest-DeleteServersTestJSON-51385704 tempest-DeleteServersTestJSON-51385704-project-member] Enqueued Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_members [ 656.518182] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_members [ 656.520891] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-704e5eab-aa44-4493-8c9a-0b24250e7bea taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.520891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.520891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.520891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.520891] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.520891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.520891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.520891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.520891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.520891] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.013060] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.013300] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.013401] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.013722] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.013840] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.014060] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.014159] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.014223] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.014824] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.014824] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.014824] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96893623-1913-4658-8960-6e93015a062e is going to be updated. [ 657.026845] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.027218] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.027353] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.031601] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.031706] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.031989] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.032112] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.032154] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.032460] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.032460] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.032557] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea is going to be updated. [ 657.051050] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.051050] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.051373] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.051373] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.051514] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.065772] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96893623-1913-4658-8960-6e93015a062e in Status: IN_PROGRESS for 2s [ 657.074933] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.075158] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.075257] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.075535] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.075718] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.086966] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: IN_PROGRESS for 2s [ 658.241045] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1dbab98-9c58-424b-aadb-07860f808828 in Status: UNINITIALIZED for 4s [ 658.500644] env[66502]: INFO networking_nsxv3.common.synchronization [None req-af331429-4c53-4367-a04a-4faa8313f447 None None] Enqueued Resource ID: 62c008ce-952f-4aab-9e35-e2f4e76b7731 with Priority: HIGHEST for action port [ 658.501941] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62c008ce-952f-4aab-9e35-e2f4e76b7731 with Priority: HIGHEST for action port [ 658.503985] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-62c008ce-952f-4aab-9e35-e2f4e76b7731 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.503985] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-62c008ce-952f-4aab-9e35-e2f4e76b7731" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.503985] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-62c008ce-952f-4aab-9e35-e2f4e76b7731" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.503985] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-62c008ce-952f-4aab-9e35-e2f4e76b7731" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.503985] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('62c008ce-952f-4aab-9e35-e2f4e76b7731',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.010321] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 62c008ce-952f-4aab-9e35-e2f4e76b7731 [ 659.010321] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.010321] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.010321] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.010321] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.010321] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.010321] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:62c008ce-952f-4aab-9e35-e2f4e76b7731 already deleted. [ 659.010321] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-62c008ce-952f-4aab-9e35-e2f4e76b7731" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.082246] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 96893623-1913-4658-8960-6e93015a062e in Status: SUCCESS [ 659.082246] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 96893623-1913-4658-8960-6e93015a062e deletion is rescheduled due to dependency. [ 659.082246] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-96893623-1913-4658-8960-6e93015a062e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.100261] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: SUCCESS [ 659.100584] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea deletion is rescheduled due to dependency. [ 659.100788] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.439520] env[66502]: INFO networking_nsxv3.common.synchronization [None req-9647ff1e-49f6-4283-bd67-9219fe49d522 None None] Enqueued Resource ID: ca66ebb3-582a-4477-935c-0a4abccd0e2c with Priority: HIGHEST for action port [ 659.440256] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca66ebb3-582a-4477-935c-0a4abccd0e2c with Priority: HIGHEST for action port [ 659.440425] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca66ebb3-582a-4477-935c-0a4abccd0e2c taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.440569] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca66ebb3-582a-4477-935c-0a4abccd0e2c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.440638] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca66ebb3-582a-4477-935c-0a4abccd0e2c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.440949] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca66ebb3-582a-4477-935c-0a4abccd0e2c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.442836] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca66ebb3-582a-4477-935c-0a4abccd0e2c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.944805] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ca66ebb3-582a-4477-935c-0a4abccd0e2c [ 659.946266] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.946266] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.946266] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.946266] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.946266] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.946266] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ca66ebb3-582a-4477-935c-0a4abccd0e2c already deleted. [ 659.946266] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca66ebb3-582a-4477-935c-0a4abccd0e2c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.253041] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1dbab98-9c58-424b-aadb-07860f808828 in Status: SUCCESS [ 660.253387] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1dbab98-9c58-424b-aadb-07860f808828" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.253490] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1dbab98-9c58-424b-aadb-07860f808828" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.254097] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1dbab98-9c58-424b-aadb-07860f808828" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.254097] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.254266] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.254266] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.254365] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.255119] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.255119] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1dbab98-9c58-424b-aadb-07860f808828" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.255119] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b1dbab98-9c58-424b-aadb-07860f808828',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.762428] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1dbab98-9c58-424b-aadb-07860f808828 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.762842] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1dbab98-9c58-424b-aadb-07860f808828" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.762842] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1dbab98-9c58-424b-aadb-07860f808828" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.762962] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1dbab98-9c58-424b-aadb-07860f808828" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.763157] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.763277] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.763344] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.763512] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.763613] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.763666] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1dbab98-9c58-424b-aadb-07860f808828" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.763813] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1dbab98-9c58-424b-aadb-07860f808828 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.763913] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1dbab98-9c58-424b-aadb-07860f808828" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.763965] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1dbab98-9c58-424b-aadb-07860f808828" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.764125] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1dbab98-9c58-424b-aadb-07860f808828" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.764265] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.764356] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.764448] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.764563] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.764641] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.764728] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1dbab98-9c58-424b-aadb-07860f808828" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.764818] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b1dbab98-9c58-424b-aadb-07860f808828',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.269917] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b1dbab98-9c58-424b-aadb-07860f808828: rpc.has_security_group_logging(os_id): False [ 661.299025] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.299025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.299025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.299025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.299025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.299025] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.299025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.299025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.299025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.299025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.299025] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.299025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.299025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.299025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.299025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.299771] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.299771] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.299771] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.303057] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.303057] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.303057] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1dbab98-9c58-424b-aadb-07860f808828 is going to be created. [ 661.383769] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.383769] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.383769] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.383769] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.383769] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.404717] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1dbab98-9c58-424b-aadb-07860f808828 in Status: IN_PROGRESS for 2s [ 661.506958] env[66502]: INFO networking_nsxv3.common.synchronization [None req-149b04b4-df2b-49b6-9197-eaa3130a37fb None None] Enqueued Resource ID: 28c64e04-43e5-40cc-bc46-19738836dad5 with Priority: HIGHEST for action port [ 661.513030] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 28c64e04-43e5-40cc-bc46-19738836dad5 with Priority: HIGHEST for action port [ 661.513030] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-28c64e04-43e5-40cc-bc46-19738836dad5 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.513030] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-28c64e04-43e5-40cc-bc46-19738836dad5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.513030] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-28c64e04-43e5-40cc-bc46-19738836dad5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.513030] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-28c64e04-43e5-40cc-bc46-19738836dad5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.513501] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('28c64e04-43e5-40cc-bc46-19738836dad5',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.638012] env[66502]: INFO networking_nsxv3.common.synchronization [None req-4b9e3f43-19cc-4c01-9a77-0fb810f26e8a None None] Enqueued Resource ID: 76406724-666d-4be1-93b2-b0825d7d9ab3 with Priority: HIGHEST for action port [ 661.638596] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76406724-666d-4be1-93b2-b0825d7d9ab3 with Priority: HIGHEST for action port [ 661.640030] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-76406724-666d-4be1-93b2-b0825d7d9ab3 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.640030] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-76406724-666d-4be1-93b2-b0825d7d9ab3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.640030] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-76406724-666d-4be1-93b2-b0825d7d9ab3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.640030] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-76406724-666d-4be1-93b2-b0825d7d9ab3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.640030] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76406724-666d-4be1-93b2-b0825d7d9ab3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.018921] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 28c64e04-43e5-40cc-bc46-19738836dad5 [ 662.018921] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.018921] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.018921] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.018921] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.018921] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.018921] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:28c64e04-43e5-40cc-bc46-19738836dad5 already deleted. [ 662.018921] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-28c64e04-43e5-40cc-bc46-19738836dad5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.146051] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 76406724-666d-4be1-93b2-b0825d7d9ab3 [ 662.146539] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.146539] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.146539] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.146745] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.146783] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.146875] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:76406724-666d-4be1-93b2-b0825d7d9ab3 already deleted. [ 662.146956] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-76406724-666d-4be1-93b2-b0825d7d9ab3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.184272] env[66502]: INFO networking_nsxv3.common.synchronization [req-35b636ed-2114-46c7-b245-392574d0ed2a req-3793da9d-8e52-44da-9f24-bff292e5c3e7 tempest-ImagesTestJSON-1088460097 tempest-ImagesTestJSON-1088460097-project-member] Enqueued Resource ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 with Priority: HIGHEST for action security_group_members [ 662.184272] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 with Priority: HIGHEST for action security_group_members [ 662.187514] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.187681] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.187768] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.188070] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.188271] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.188646] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.189357] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.189357] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.189357] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.189357] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.694942] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.696345] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.696345] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.696658] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.696943] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.697405] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.697549] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.697635] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.698193] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.698287] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.698385] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 is going to be updated. [ 662.734665] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.734926] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.735019] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.735246] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.735402] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.747249] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 in Status: IN_PROGRESS for 2s [ 663.318239] env[66502]: INFO networking_nsxv3.common.synchronization [None req-f18d5676-ac33-4e11-b78d-089467e220a5 None None] Enqueued Resource ID: 5882049b-a0e7-4046-9705-40bfe2c890f5 with Priority: HIGHEST for action port [ 663.318544] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5882049b-a0e7-4046-9705-40bfe2c890f5 with Priority: HIGHEST for action port [ 663.319043] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-5882049b-a0e7-4046-9705-40bfe2c890f5 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.319162] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5882049b-a0e7-4046-9705-40bfe2c890f5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.319220] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5882049b-a0e7-4046-9705-40bfe2c890f5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.319446] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5882049b-a0e7-4046-9705-40bfe2c890f5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.319529] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5882049b-a0e7-4046-9705-40bfe2c890f5',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 663.425072] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b1dbab98-9c58-424b-aadb-07860f808828 in Status: SUCCESS [ 663.425656] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1dbab98-9c58-424b-aadb-07860f808828" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.822550] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5882049b-a0e7-4046-9705-40bfe2c890f5 [ 663.823804] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.823804] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.823804] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.823804] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.823804] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.823804] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5882049b-a0e7-4046-9705-40bfe2c890f5 already deleted. [ 663.823804] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5882049b-a0e7-4046-9705-40bfe2c890f5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.133977] env[66502]: INFO networking_nsxv3.common.synchronization [None req-290ffa6f-08f9-46ae-9bea-fee5fd08f489 None None] Enqueued Resource ID: c14f797f-9a84-4a74-aeda-9cd074536149 with Priority: HIGHEST for action port [ 664.133977] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c14f797f-9a84-4a74-aeda-9cd074536149 with Priority: HIGHEST for action port [ 664.133977] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-c14f797f-9a84-4a74-aeda-9cd074536149 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.133977] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c14f797f-9a84-4a74-aeda-9cd074536149" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.133977] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c14f797f-9a84-4a74-aeda-9cd074536149" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.133977] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c14f797f-9a84-4a74-aeda-9cd074536149" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.133977] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c14f797f-9a84-4a74-aeda-9cd074536149',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.636399] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c14f797f-9a84-4a74-aeda-9cd074536149 [ 664.636764] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 664.636764] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 664.636865] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 664.637680] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 664.637680] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.637680] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c14f797f-9a84-4a74-aeda-9cd074536149 already deleted. [ 664.637680] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c14f797f-9a84-4a74-aeda-9cd074536149" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 664.760504] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 in Status: SUCCESS [ 664.760504] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 deletion is rescheduled due to dependency. [ 664.760504] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.365977] env[66502]: INFO networking_nsxv3.common.synchronization [None req-0c687356-2d42-437d-a33f-0ec04404fd6c None None] Enqueued Resource ID: c47a494f-135a-456b-b9c1-175051b1dbf5 with Priority: HIGHEST for action port [ 667.366546] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c47a494f-135a-456b-b9c1-175051b1dbf5 with Priority: HIGHEST for action port [ 667.366927] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-c47a494f-135a-456b-b9c1-175051b1dbf5 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.367078] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c47a494f-135a-456b-b9c1-175051b1dbf5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.367882] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c47a494f-135a-456b-b9c1-175051b1dbf5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.368794] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c47a494f-135a-456b-b9c1-175051b1dbf5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.368895] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c47a494f-135a-456b-b9c1-175051b1dbf5',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.871890] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c47a494f-135a-456b-b9c1-175051b1dbf5 [ 667.875405] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.875405] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.875405] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.875405] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.875405] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.875405] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c47a494f-135a-456b-b9c1-175051b1dbf5 already deleted. [ 667.875405] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c47a494f-135a-456b-b9c1-175051b1dbf5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.486412] env[66502]: INFO networking_nsxv3.common.synchronization [None req-1e5e205d-6edc-402d-8b48-e069a1c2b264 None None] Enqueued Resource ID: 3739e3ac-7246-46a9-a53f-056ebfe6f8eb with Priority: HIGHEST for action port [ 668.486412] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3739e3ac-7246-46a9-a53f-056ebfe6f8eb with Priority: HIGHEST for action port [ 668.486412] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-3739e3ac-7246-46a9-a53f-056ebfe6f8eb taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.486412] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3739e3ac-7246-46a9-a53f-056ebfe6f8eb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.486412] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3739e3ac-7246-46a9-a53f-056ebfe6f8eb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.486412] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3739e3ac-7246-46a9-a53f-056ebfe6f8eb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.486412] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3739e3ac-7246-46a9-a53f-056ebfe6f8eb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.989849] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3739e3ac-7246-46a9-a53f-056ebfe6f8eb [ 668.990258] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.990594] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.990873] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.991201] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.991619] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.992028] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3739e3ac-7246-46a9-a53f-056ebfe6f8eb already deleted. [ 668.996492] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3739e3ac-7246-46a9-a53f-056ebfe6f8eb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.188818] env[66502]: INFO networking_nsxv3.common.synchronization [req-3d60edc7-f11a-454d-bf80-c6085528fd52 req-131337ea-a5fb-46a8-a657-c31956d4f4cc tempest-DeleteServersAdminTestJSON-418815838 tempest-DeleteServersAdminTestJSON-418815838-project-member] Enqueued Resource ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 with Priority: HIGHEST for action security_group_members [ 669.189182] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 with Priority: HIGHEST for action security_group_members [ 669.189486] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-67c97dc5-9d08-4219-aa00-0b83a223ae57 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.189613] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.189682] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.189877] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.190847] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.190847] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.190847] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.190847] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.190847] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.190847] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67c97dc5-9d08-4219-aa00-0b83a223ae57',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.625737] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-670 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.626127] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.626127] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.626340] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.626592] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.626744] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.626856] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.627191] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.627305] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.627853] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 669.627853] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 669.627853] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 669.628042] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 669.628042] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 669.630906] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 669.630906] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 669.652272] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 669.652586] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 669.652669] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 669.653024] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.653214] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-261d074c-89be-49a6-afdd-b0d5fee6e6b3 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.653989] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-261d074c-89be-49a6-afdd-b0d5fee6e6b3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.654180] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-261d074c-89be-49a6-afdd-b0d5fee6e6b3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.656857] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-261d074c-89be-49a6-afdd-b0d5fee6e6b3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.656857] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('261d074c-89be-49a6-afdd-b0d5fee6e6b3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.694784] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.695176] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.695398] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.695635] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.695757] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.697033] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.697033] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.697033] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.697033] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.697033] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.697033] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 is going to be updated. [ 669.729021] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.729175] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.729246] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.729465] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.729598] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.742775] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 in Status: IN_PROGRESS for 2s [ 670.106508] env[66502]: INFO networking_nsxv3.common.synchronization [None req-7006cc5d-fe49-4dea-b92c-6ccf43170be9 None None] Enqueued Resource ID: 4217c12f-de4f-497f-8ab9-d10eb83e025e with Priority: HIGHEST for action port [ 670.107261] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4217c12f-de4f-497f-8ab9-d10eb83e025e with Priority: HIGHEST for action port [ 670.107348] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-4217c12f-de4f-497f-8ab9-d10eb83e025e taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.108298] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4217c12f-de4f-497f-8ab9-d10eb83e025e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.108298] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4217c12f-de4f-497f-8ab9-d10eb83e025e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.108298] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4217c12f-de4f-497f-8ab9-d10eb83e025e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.108298] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4217c12f-de4f-497f-8ab9-d10eb83e025e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.128724] env[66502]: INFO networking_nsxv3.common.synchronization [None req-2dfc7646-3996-4d64-bcf2-864188a59559 tempest-ServersTestBootFromVolume-1686244991 tempest-ServersTestBootFromVolume-1686244991-project-member] Enqueued Resource ID: eeb100e3-e5a7-4d38-a030-42278dbe1366 with Priority: HIGHEST for action security_group_rules [ 670.130648] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eeb100e3-e5a7-4d38-a030-42278dbe1366 with Priority: HIGHEST for action security_group_rules [ 670.130809] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eeb100e3-e5a7-4d38-a030-42278dbe1366 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.130934] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eeb100e3-e5a7-4d38-a030-42278dbe1366" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.130996] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eeb100e3-e5a7-4d38-a030-42278dbe1366" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.131569] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eeb100e3-e5a7-4d38-a030-42278dbe1366" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.132586] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eeb100e3-e5a7-4d38-a030-42278dbe1366',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.157840] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.158122] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.158250] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.158685] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.158828] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.158987] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 261d074c-89be-49a6-afdd-b0d5fee6e6b3 not found, creating... [ 670.159288] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.159440] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.159550] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.159769] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.159895] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.160184] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.160333] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.160439] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.160636] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.163216] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.163412] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 261d074c-89be-49a6-afdd-b0d5fee6e6b3 is going to be created. [ 670.190073] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.190073] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.190073] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.190073] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.190073] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.190831] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-261d074c-89be-49a6-afdd-b0d5fee6e6b3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.238046] env[66502]: INFO networking_nsxv3.common.synchronization [None req-5db3dfb2-8493-4196-bf2a-f1f8d00b5a5d tempest-ServersTestBootFromVolume-1686244991 tempest-ServersTestBootFromVolume-1686244991-project-member] Enqueued Resource ID: eeb100e3-e5a7-4d38-a030-42278dbe1366 with Priority: HIGHEST for action security_group_rules [ 670.240648] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eeb100e3-e5a7-4d38-a030-42278dbe1366 with Priority: HIGHEST for action security_group_rules [ 670.243417] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eeb100e3-e5a7-4d38-a030-42278dbe1366 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.243533] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eeb100e3-e5a7-4d38-a030-42278dbe1366" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.616766] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4217c12f-de4f-497f-8ab9-d10eb83e025e [ 670.616766] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.616766] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.616766] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.616766] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.616766] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.616766] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4217c12f-de4f-497f-8ab9-d10eb83e025e already deleted. [ 670.616766] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4217c12f-de4f-497f-8ab9-d10eb83e025e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.656248] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.656248] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.656248] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.656248] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.656248] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.656248] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eeb100e3-e5a7-4d38-a030-42278dbe1366 already deleted. [ 670.656248] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eeb100e3-e5a7-4d38-a030-42278dbe1366" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.656248] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eeb100e3-e5a7-4d38-a030-42278dbe1366" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.656248] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eeb100e3-e5a7-4d38-a030-42278dbe1366" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.656248] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eeb100e3-e5a7-4d38-a030-42278dbe1366',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.980550] env[66502]: INFO networking_nsxv3.common.synchronization [req-3d60edc7-f11a-454d-bf80-c6085528fd52 req-9984b963-ca6a-4af9-afa7-352b4547bd52 service nova] Enqueued Resource ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 with Priority: HIGHEST for action security_group_rules [ 670.980636] env[66502]: INFO networking_nsxv3.common.synchronization [req-3d60edc7-f11a-454d-bf80-c6085528fd52 req-9984b963-ca6a-4af9-afa7-352b4547bd52 service nova] Enqueued Resource ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 with Priority: HIGHEST for action security_group_members [ 670.981081] env[66502]: INFO networking_nsxv3.common.synchronization [req-3d60edc7-f11a-454d-bf80-c6085528fd52 req-9984b963-ca6a-4af9-afa7-352b4547bd52 service nova] Enqueued Resource ID: 261d074c-89be-49a6-afdd-b0d5fee6e6b3 with Priority: HIGHEST for action port [ 670.981365] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 with Priority: HIGHEST for action security_group_rules [ 670.981505] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 with Priority: HIGHEST for action security_group_members [ 670.981591] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 261d074c-89be-49a6-afdd-b0d5fee6e6b3 with Priority: HIGHEST for action port [ 670.981884] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-67c97dc5-9d08-4219-aa00-0b83a223ae57 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.982024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.988256] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.988256] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.988256] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('67c97dc5-9d08-4219-aa00-0b83a223ae57',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.988256] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-67c97dc5-9d08-4219-aa00-0b83a223ae57 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.988256] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.988256] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-261d074c-89be-49a6-afdd-b0d5fee6e6b3 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.988256] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-261d074c-89be-49a6-afdd-b0d5fee6e6b3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.988256] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-261d074c-89be-49a6-afdd-b0d5fee6e6b3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.988256] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-261d074c-89be-49a6-afdd-b0d5fee6e6b3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.988256] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('261d074c-89be-49a6-afdd-b0d5fee6e6b3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.177742] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.177909] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.177984] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.178219] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.178310] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.178404] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eeb100e3-e5a7-4d38-a030-42278dbe1366 already deleted. [ 671.178508] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eeb100e3-e5a7-4d38-a030-42278dbe1366" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.495815] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 261d074c-89be-49a6-afdd-b0d5fee6e6b3 with status ACTIVE [ 671.495815] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.496030] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.496030] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.496198] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.496344] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.497408] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.497408] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.497408] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.497408] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.497408] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.497408] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.497408] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.497408] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.497963] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.497963] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.497963] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 261d074c-89be-49a6-afdd-b0d5fee6e6b3 is going to be updated. [ 671.499688] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-67c97dc5-9d08-4219-aa00-0b83a223ae57 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.499688] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.530072] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.530242] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.530313] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.530527] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.530658] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.530815] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-261d074c-89be-49a6-afdd-b0d5fee6e6b3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.756214] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 in Status: SUCCESS [ 671.756534] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 deletion is rescheduled due to dependency. [ 671.756534] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.758483] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.758483] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.758483] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.758483] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.758483] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.758483] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.758483] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.758483] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67c97dc5-9d08-4219-aa00-0b83a223ae57',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.065169] env[66502]: INFO networking_nsxv3.common.synchronization [None req-e4496a1c-cccc-4519-abb9-dd5ce879bf76 None None] Enqueued Resource ID: 449f6c12-a7f1-48de-8521-d81799a6081e with Priority: HIGHEST for action port [ 672.065169] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 449f6c12-a7f1-48de-8521-d81799a6081e with Priority: HIGHEST for action port [ 672.065308] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-449f6c12-a7f1-48de-8521-d81799a6081e taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.065428] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-449f6c12-a7f1-48de-8521-d81799a6081e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.065493] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-449f6c12-a7f1-48de-8521-d81799a6081e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.065870] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-449f6c12-a7f1-48de-8521-d81799a6081e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.065870] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('449f6c12-a7f1-48de-8521-d81799a6081e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.264789] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('67c97dc5-9d08-4219-aa00-0b83a223ae57',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.568248] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 449f6c12-a7f1-48de-8521-d81799a6081e [ 672.568498] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.568634] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.568706] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.569500] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.569500] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.569500] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:449f6c12-a7f1-48de-8521-d81799a6081e already deleted. [ 672.569500] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-449f6c12-a7f1-48de-8521-d81799a6081e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.768033] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('67c97dc5-9d08-4219-aa00-0b83a223ae57',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.270595] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.270810] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.270810] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.270950] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.271055] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.271154] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 is going to be updated. [ 673.302403] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.302649] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.302779] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.303229] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.303474] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 673.315132] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 in Status: IN_PROGRESS for 2s [ 675.335030] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 in Status: SUCCESS [ 675.335030] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.335427] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.335483] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.335674] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.335825] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.335871] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.335997] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.336084] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.336161] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.336249] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('67c97dc5-9d08-4219-aa00-0b83a223ae57',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.844880] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-67c97dc5-9d08-4219-aa00-0b83a223ae57 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.845094] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.845175] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.845394] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.845558] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.845658] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.845785] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.845858] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.845941] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.846044] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.846212] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-67c97dc5-9d08-4219-aa00-0b83a223ae57 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.846300] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.846360] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.846503] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.846685] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.846779] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.846821] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.847230] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.847230] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.847230] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.847230] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('67c97dc5-9d08-4219-aa00-0b83a223ae57',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.350982] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 67c97dc5-9d08-4219-aa00-0b83a223ae57: rpc.has_security_group_logging(os_id): False [ 676.377832] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.378010] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.378052] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.378277] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.378470] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.379396] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.379396] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.379396] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.379396] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.379396] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.379396] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.379396] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.379861] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.380256] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.380368] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.380578] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.380693] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.380758] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.380895] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.380979] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.381559] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 is going to be updated. [ 676.467326] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.467501] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.467568] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.467783] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.467921] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.484066] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 in Status: IN_PROGRESS for 2s [ 677.065932] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 677.066092] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 677.899225] env[66502]: INFO networking_nsxv3.common.synchronization [None req-30329f64-9305-4033-99a1-73353097f17f None None] Enqueued Resource ID: 768e3de5-f51b-4fa8-be9f-5a0df62cca24 with Priority: HIGHEST for action port [ 677.899834] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 768e3de5-f51b-4fa8-be9f-5a0df62cca24 with Priority: HIGHEST for action port [ 677.901871] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-768e3de5-f51b-4fa8-be9f-5a0df62cca24 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.901871] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-768e3de5-f51b-4fa8-be9f-5a0df62cca24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.901871] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-768e3de5-f51b-4fa8-be9f-5a0df62cca24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.901871] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-768e3de5-f51b-4fa8-be9f-5a0df62cca24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.901871] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('768e3de5-f51b-4fa8-be9f-5a0df62cca24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.409141] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 768e3de5-f51b-4fa8-be9f-5a0df62cca24 [ 678.410056] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.410300] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.410387] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.410719] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.410862] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.410973] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:768e3de5-f51b-4fa8-be9f-5a0df62cca24 already deleted. [ 678.411079] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-768e3de5-f51b-4fa8-be9f-5a0df62cca24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.501238] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 in Status: SUCCESS [ 678.501445] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.528547] env[66502]: INFO networking_nsxv3.common.synchronization [req-1b86e7d1-69a5-4998-93cc-5f18903369a1 req-6dae4e29-a00b-49ac-862a-e6f0a38136be tempest-ListServersNegativeTestJSON-658181297 tempest-ListServersNegativeTestJSON-658181297-project-member] Enqueued Resource ID: d777850f-4bcd-420d-ab88-295134770a5c with Priority: HIGHEST for action security_group_members [ 679.529391] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d777850f-4bcd-420d-ab88-295134770a5c with Priority: HIGHEST for action security_group_members [ 679.529738] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-d777850f-4bcd-420d-ab88-295134770a5c taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.529968] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.530049] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.530266] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.530807] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.530912] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.530971] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.531308] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.531418] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.531519] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d777850f-4bcd-420d-ab88-295134770a5c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.035318] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d777850f-4bcd-420d-ab88-295134770a5c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.101375] env[66502]: INFO networking_nsxv3.common.synchronization [None req-49d157af-c3f6-4bb6-aa0e-a6e2d0d4ca1b None None] Enqueued Resource ID: fbf432dd-8033-472f-ab42-1809a277edb8 with Priority: HIGHEST for action port [ 680.104185] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbf432dd-8033-472f-ab42-1809a277edb8 with Priority: HIGHEST for action port [ 680.104185] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-fbf432dd-8033-472f-ab42-1809a277edb8 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.104185] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fbf432dd-8033-472f-ab42-1809a277edb8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.104185] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fbf432dd-8033-472f-ab42-1809a277edb8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.104185] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fbf432dd-8033-472f-ab42-1809a277edb8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.105393] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fbf432dd-8033-472f-ab42-1809a277edb8',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.223529] env[66502]: INFO networking_nsxv3.common.synchronization [req-901303b7-3f0e-4c98-9a18-beacf861f0e4 req-2071f858-03dc-419c-9953-629c2c7ce01c tempest-FloatingIPsAssociationTestJSON-843355077 tempest-FloatingIPsAssociationTestJSON-843355077-project-member] Enqueued Resource ID: e12852c1-7dc2-4ed2-bd34-e396f9f9256d with Priority: HIGHEST for action security_group_members [ 680.225485] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e12852c1-7dc2-4ed2-bd34-e396f9f9256d with Priority: HIGHEST for action security_group_members [ 680.225485] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.225485] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.225485] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.226449] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.226616] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.226722] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.226778] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.226941] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.227079] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.227188] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e12852c1-7dc2-4ed2-bd34-e396f9f9256d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.540035] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d777850f-4bcd-420d-ab88-295134770a5c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.610158] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fbf432dd-8033-472f-ab42-1809a277edb8 [ 680.611147] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.611147] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.611147] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.611147] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.611147] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.611147] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fbf432dd-8033-472f-ab42-1809a277edb8 already deleted. [ 680.611147] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fbf432dd-8033-472f-ab42-1809a277edb8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.707995] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-84 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.708247] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-84" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.708387] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-84" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.708698] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-84" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.709011] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.709389] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.709519] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.709785] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.709971] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.710242] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 680.710442] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 680.710507] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 680.710622] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 680.710757] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 680.710879] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 680.711049] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 680.730768] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e12852c1-7dc2-4ed2-bd34-e396f9f9256d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.734101] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 680.734362] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 680.734547] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 680.734786] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-84" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.735237] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-a932de77-c65b-47ac-b825-375309b1ce4a taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.735492] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-a932de77-c65b-47ac-b825-375309b1ce4a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.735682] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-a932de77-c65b-47ac-b825-375309b1ce4a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.736129] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-a932de77-c65b-47ac-b825-375309b1ce4a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.736356] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a932de77-c65b-47ac-b825-375309b1ce4a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.044562] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.044771] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.044853] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.045356] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.045480] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.045588] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d777850f-4bcd-420d-ab88-295134770a5c is going to be updated. [ 681.080091] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.080091] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.080091] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.080091] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.080091] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.087930] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d777850f-4bcd-420d-ab88-295134770a5c in Status: IN_PROGRESS for 2s [ 681.136295] env[66502]: INFO networking_nsxv3.common.synchronization [req-d957de3f-646e-4323-b6ae-c1e31f95ed6c req-6d516848-e6cb-43ce-bf98-f3c808ce7d67 tempest-ListServersNegativeTestJSON-658181297 tempest-ListServersNegativeTestJSON-658181297-project-member] Enqueued Resource ID: d777850f-4bcd-420d-ab88-295134770a5c with Priority: HIGHEST for action security_group_members [ 681.139505] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d777850f-4bcd-420d-ab88-295134770a5c with Priority: HIGHEST for action security_group_members [ 681.139505] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-d777850f-4bcd-420d-ab88-295134770a5c taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.139505] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.233922] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e12852c1-7dc2-4ed2-bd34-e396f9f9256d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.242024] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.242024] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.242024] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.242024] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.242024] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.242024] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port a932de77-c65b-47ac-b825-375309b1ce4a not found, creating... [ 681.242024] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.242024] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.242024] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.242024] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.242024] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.242706] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.242706] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.242706] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.243434] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.244188] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.246852] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: a932de77-c65b-47ac-b825-375309b1ce4a is going to be created. [ 681.267663] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.267875] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.267992] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.268302] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.268527] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.268748] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-a932de77-c65b-47ac-b825-375309b1ce4a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.466352] env[66502]: INFO networking_nsxv3.common.synchronization [None req-cdd516b9-1dcb-4b8d-84f2-4be6084569b3 None None] Enqueued Resource ID: c3c08025-f6f4-44d8-b5a4-fbd19fbb48e3 with Priority: HIGHEST for action port [ 681.467384] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3c08025-f6f4-44d8-b5a4-fbd19fbb48e3 with Priority: HIGHEST for action port [ 681.467687] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3c08025-f6f4-44d8-b5a4-fbd19fbb48e3 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.467975] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3c08025-f6f4-44d8-b5a4-fbd19fbb48e3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.467975] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3c08025-f6f4-44d8-b5a4-fbd19fbb48e3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.468349] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3c08025-f6f4-44d8-b5a4-fbd19fbb48e3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.468465] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3c08025-f6f4-44d8-b5a4-fbd19fbb48e3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.737393] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.737888] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.737888] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.738093] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.738250] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.738393] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e12852c1-7dc2-4ed2-bd34-e396f9f9256d is going to be updated. [ 681.772935] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.773141] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.773194] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.773437] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.773604] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.783148] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e12852c1-7dc2-4ed2-bd34-e396f9f9256d in Status: IN_PROGRESS for 2s [ 681.973036] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c3c08025-f6f4-44d8-b5a4-fbd19fbb48e3 [ 681.973036] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.973036] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.973036] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.973036] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.973036] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.973036] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c3c08025-f6f4-44d8-b5a4-fbd19fbb48e3 already deleted. [ 681.973036] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3c08025-f6f4-44d8-b5a4-fbd19fbb48e3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.004450] env[66502]: INFO networking_nsxv3.common.synchronization [req-901303b7-3f0e-4c98-9a18-beacf861f0e4 req-eb28660d-1074-4b70-8a9d-1c6b24e032ba service nova] Enqueued Resource ID: e12852c1-7dc2-4ed2-bd34-e396f9f9256d with Priority: HIGHEST for action security_group_rules [ 682.004655] env[66502]: INFO networking_nsxv3.common.synchronization [req-901303b7-3f0e-4c98-9a18-beacf861f0e4 req-eb28660d-1074-4b70-8a9d-1c6b24e032ba service nova] Enqueued Resource ID: e12852c1-7dc2-4ed2-bd34-e396f9f9256d with Priority: HIGHEST for action security_group_members [ 682.004852] env[66502]: INFO networking_nsxv3.common.synchronization [req-901303b7-3f0e-4c98-9a18-beacf861f0e4 req-eb28660d-1074-4b70-8a9d-1c6b24e032ba service nova] Enqueued Resource ID: a932de77-c65b-47ac-b825-375309b1ce4a with Priority: HIGHEST for action port [ 682.005117] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e12852c1-7dc2-4ed2-bd34-e396f9f9256d with Priority: HIGHEST for action security_group_rules [ 682.005225] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e12852c1-7dc2-4ed2-bd34-e396f9f9256d with Priority: HIGHEST for action security_group_members [ 682.005310] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a932de77-c65b-47ac-b825-375309b1ce4a with Priority: HIGHEST for action port [ 682.005885] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e12852c1-7dc2-4ed2-bd34-e396f9f9256d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.006160] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.006249] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.006454] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.006538] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e12852c1-7dc2-4ed2-bd34-e396f9f9256d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.008605] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.008605] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.008605] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-a932de77-c65b-47ac-b825-375309b1ce4a taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.008605] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a932de77-c65b-47ac-b825-375309b1ce4a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.008605] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a932de77-c65b-47ac-b825-375309b1ce4a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.008605] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a932de77-c65b-47ac-b825-375309b1ce4a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.008605] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a932de77-c65b-47ac-b825-375309b1ce4a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.517347] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.517482] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.517685] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a932de77-c65b-47ac-b825-375309b1ce4a with status ACTIVE [ 682.517854] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.517960] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.518039] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.518298] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.519203] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.519387] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.519483] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.519550] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.519736] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.519817] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.520085] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.520210] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.520290] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.520505] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.520588] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.520677] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a932de77-c65b-47ac-b825-375309b1ce4a is going to be updated. [ 682.546119] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.546272] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.546345] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.546576] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.546865] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.546865] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a932de77-c65b-47ac-b825-375309b1ce4a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.730221] env[66502]: INFO networking_nsxv3.common.synchronization [req-9d5fc6a8-f5c5-4cfe-98bc-5a81d50d77a2 req-45fb59df-dbf4-4333-bc1d-c54e49c23506 tempest-VolumesAdminNegativeTest-898295607 tempest-VolumesAdminNegativeTest-898295607-project-member] Enqueued Resource ID: 32ff0aad-cfa5-4379-8483-9c7077a46f10 with Priority: HIGHEST for action security_group_members [ 682.730741] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32ff0aad-cfa5-4379-8483-9c7077a46f10 with Priority: HIGHEST for action security_group_members [ 682.731242] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-32ff0aad-cfa5-4379-8483-9c7077a46f10 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.731363] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32ff0aad-cfa5-4379-8483-9c7077a46f10" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.731427] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32ff0aad-cfa5-4379-8483-9c7077a46f10" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.732060] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32ff0aad-cfa5-4379-8483-9c7077a46f10" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.732347] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.732515] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.732620] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.732894] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.733048] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.733207] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32ff0aad-cfa5-4379-8483-9c7077a46f10',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.098322] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d777850f-4bcd-420d-ab88-295134770a5c in Status: SUCCESS [ 683.099788] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.099788] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.099788] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.101026] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.101026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.101026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.101026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.101026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.101026] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d777850f-4bcd-420d-ab88-295134770a5c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.115787] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-311 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.115787] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-311" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.115787] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-311" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.115787] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-311" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.115787] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.116691] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.116934] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.117623] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.117992] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.118484] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 683.119479] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 683.119708] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 683.120042] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 683.120413] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 683.120652] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 683.121229] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 683.142041] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 683.142215] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 683.145415] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 683.145415] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-311" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.145415] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-e55eae69-e372-4b34-881c-8a8133d5a10f taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.145415] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-e55eae69-e372-4b34-881c-8a8133d5a10f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.145415] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-e55eae69-e372-4b34-881c-8a8133d5a10f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.145415] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-e55eae69-e372-4b34-881c-8a8133d5a10f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.145415] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e55eae69-e372-4b34-881c-8a8133d5a10f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.236036] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.236036] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.236267] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.236397] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.236520] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.236736] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.236829] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.236902] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.237183] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.237248] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.237505] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32ff0aad-cfa5-4379-8483-9c7077a46f10 already deleted. [ 683.237505] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32ff0aad-cfa5-4379-8483-9c7077a46f10" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.567289] env[66502]: INFO networking_nsxv3.common.synchronization [None req-c447b891-b355-4a8e-825f-2e0a7468584e None None] Enqueued Resource ID: 267064c7-98d7-4a33-a933-0618ca4f3247 with Priority: HIGHEST for action port [ 683.570024] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 267064c7-98d7-4a33-a933-0618ca4f3247 with Priority: HIGHEST for action port [ 683.570024] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-267064c7-98d7-4a33-a933-0618ca4f3247 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.570024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-267064c7-98d7-4a33-a933-0618ca4f3247" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.570024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-267064c7-98d7-4a33-a933-0618ca4f3247" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.570024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-267064c7-98d7-4a33-a933-0618ca4f3247" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.570024] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('267064c7-98d7-4a33-a933-0618ca4f3247',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.604047] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.607025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.607025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.607025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.607025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.607025] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.607025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.607025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.607025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.607025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.607025] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d777850f-4bcd-420d-ab88-295134770a5c is going to be updated. [ 683.642347] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.642347] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.642347] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.642347] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.642347] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.648019] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.648693] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.648693] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.648869] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.649148] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.649258] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port e55eae69-e372-4b34-881c-8a8133d5a10f not found, creating... [ 683.649556] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.649700] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.649868] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.650050] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.650278] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.650507] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.650663] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.650878] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.650985] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.652260] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.652536] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: e55eae69-e372-4b34-881c-8a8133d5a10f is going to be created. [ 683.654359] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d777850f-4bcd-420d-ab88-295134770a5c in Status: IN_PROGRESS for 2s [ 683.677796] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.677796] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.677796] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.677796] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.677796] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.677796] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-e55eae69-e372-4b34-881c-8a8133d5a10f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.799319] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e12852c1-7dc2-4ed2-bd34-e396f9f9256d in Status: SUCCESS [ 683.799888] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.800174] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.800479] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.800740] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.800931] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.801140] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.801458] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.801568] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.802133] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e12852c1-7dc2-4ed2-bd34-e396f9f9256d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.073286] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 267064c7-98d7-4a33-a933-0618ca4f3247 [ 684.073535] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.073668] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.073748] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.073969] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.074067] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.074165] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:267064c7-98d7-4a33-a933-0618ca4f3247 already deleted. [ 684.074270] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-267064c7-98d7-4a33-a933-0618ca4f3247" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.305764] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e12852c1-7dc2-4ed2-bd34-e396f9f9256d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.431515] env[66502]: INFO networking_nsxv3.common.synchronization [req-9d5fc6a8-f5c5-4cfe-98bc-5a81d50d77a2 req-eca4ca7d-17e7-485e-8f15-b787a6d21671 service nova] Enqueued Resource ID: 32ff0aad-cfa5-4379-8483-9c7077a46f10 with Priority: HIGHEST for action security_group_rules [ 684.431515] env[66502]: INFO networking_nsxv3.common.synchronization [req-9d5fc6a8-f5c5-4cfe-98bc-5a81d50d77a2 req-eca4ca7d-17e7-485e-8f15-b787a6d21671 service nova] Enqueued Resource ID: 32ff0aad-cfa5-4379-8483-9c7077a46f10 with Priority: HIGHEST for action security_group_members [ 684.431515] env[66502]: INFO networking_nsxv3.common.synchronization [req-9d5fc6a8-f5c5-4cfe-98bc-5a81d50d77a2 req-eca4ca7d-17e7-485e-8f15-b787a6d21671 service nova] Enqueued Resource ID: e55eae69-e372-4b34-881c-8a8133d5a10f with Priority: HIGHEST for action port [ 684.432686] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32ff0aad-cfa5-4379-8483-9c7077a46f10 with Priority: HIGHEST for action security_group_rules [ 684.432686] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32ff0aad-cfa5-4379-8483-9c7077a46f10 with Priority: HIGHEST for action security_group_members [ 684.432686] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e55eae69-e372-4b34-881c-8a8133d5a10f with Priority: HIGHEST for action port [ 684.432826] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32ff0aad-cfa5-4379-8483-9c7077a46f10 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.432894] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32ff0aad-cfa5-4379-8483-9c7077a46f10" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.433726] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32ff0aad-cfa5-4379-8483-9c7077a46f10" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.433726] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32ff0aad-cfa5-4379-8483-9c7077a46f10" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.433726] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32ff0aad-cfa5-4379-8483-9c7077a46f10',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.434563] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-32ff0aad-cfa5-4379-8483-9c7077a46f10 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.434747] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32ff0aad-cfa5-4379-8483-9c7077a46f10" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.434849] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32ff0aad-cfa5-4379-8483-9c7077a46f10" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.435190] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32ff0aad-cfa5-4379-8483-9c7077a46f10" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.435356] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.437076] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.437076] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.437076] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.437076] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.437076] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32ff0aad-cfa5-4379-8483-9c7077a46f10',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.437937] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-e55eae69-e372-4b34-881c-8a8133d5a10f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.438087] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e55eae69-e372-4b34-881c-8a8133d5a10f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.438159] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e55eae69-e372-4b34-881c-8a8133d5a10f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.438436] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e55eae69-e372-4b34-881c-8a8133d5a10f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.438485] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e55eae69-e372-4b34-881c-8a8133d5a10f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.768477] env[66502]: INFO networking_nsxv3.common.synchronization [req-2e2b9a16-19de-440f-a138-f9470d3b627a req-68a70376-44ee-4121-a5a2-7023a2332cae tempest-SecurityGroupRulesNegativeTestJSON-95779080 tempest-SecurityGroupRulesNegativeTestJSON-95779080-project-member] Enqueued Resource ID: 34a2e2db-10ba-47ce-ae89-7d9385216043 with Priority: HIGHEST for action security_group_rules [ 684.769028] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a2e2db-10ba-47ce-ae89-7d9385216043 with Priority: HIGHEST for action security_group_rules [ 684.769328] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34a2e2db-10ba-47ce-ae89-7d9385216043 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.769454] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34a2e2db-10ba-47ce-ae89-7d9385216043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.769524] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34a2e2db-10ba-47ce-ae89-7d9385216043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.769775] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34a2e2db-10ba-47ce-ae89-7d9385216043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.769926] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34a2e2db-10ba-47ce-ae89-7d9385216043',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.813332] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e12852c1-7dc2-4ed2-bd34-e396f9f9256d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.941609] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-32ff0aad-cfa5-4379-8483-9c7077a46f10 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.941713] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32ff0aad-cfa5-4379-8483-9c7077a46f10" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.941878] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('32ff0aad-cfa5-4379-8483-9c7077a46f10',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.942808] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e55eae69-e372-4b34-881c-8a8133d5a10f with status ACTIVE [ 684.943071] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.943420] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.944948] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.947264] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.947363] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.947574] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.947691] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.947778] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.947906] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.947991] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.949120] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.949222] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.949299] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.949456] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.949523] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.949607] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e55eae69-e372-4b34-881c-8a8133d5a10f is going to be updated. [ 684.956385] env[66502]: INFO networking_nsxv3.common.synchronization [req-3ba4b262-9df4-4cd1-8f44-afa597ba05b2 req-734bbfeb-0038-4c1f-b8cf-2fb04f40a137 tempest-ServerActionsTestJSON-2133613622 tempest-ServerActionsTestJSON-2133613622-project-member] Enqueued Resource ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 with Priority: HIGHEST for action security_group_members [ 684.958019] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 with Priority: HIGHEST for action security_group_members [ 684.958352] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.958476] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.958537] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.958802] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.958958] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.959129] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.959186] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.959345] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.959433] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.959531] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ab1d50c-f5a6-4aaf-829b-d0cfdf164722',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.985638] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.985807] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.985944] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.986210] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.986362] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.986531] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e55eae69-e372-4b34-881c-8a8133d5a10f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.307681] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.308535] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.308535] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.308535] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.308535] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.308723] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34a2e2db-10ba-47ce-ae89-7d9385216043 already deleted. [ 685.308723] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34a2e2db-10ba-47ce-ae89-7d9385216043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.314086] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.314086] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.314086] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.315377] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.315377] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.315377] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e12852c1-7dc2-4ed2-bd34-e396f9f9256d is going to be updated. [ 685.392337] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.392337] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.392337] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.392337] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.392508] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.407710] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e12852c1-7dc2-4ed2-bd34-e396f9f9256d in Status: IN_PROGRESS for 2s [ 685.433512] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-834 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.435049] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-834" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.435049] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-834" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.435049] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-834" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.435531] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.437204] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.437204] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.437204] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.438861] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.442721] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 685.442721] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 685.442721] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 685.442721] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 685.442721] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 685.442721] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 685.442721] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 685.451331] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('32ff0aad-cfa5-4379-8483-9c7077a46f10',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.464610] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 685.465106] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 685.465106] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 685.465746] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-834" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.466238] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-21ae3397-1891-4784-8453-551b53f732f8 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.466554] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-21ae3397-1891-4784-8453-551b53f732f8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.466791] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-21ae3397-1891-4784-8453-551b53f732f8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.467314] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-21ae3397-1891-4784-8453-551b53f732f8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.467500] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21ae3397-1891-4784-8453-551b53f732f8',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.469983] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.470327] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.470388] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.472336] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.472336] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.472336] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.472336] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.472336] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.472336] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.472336] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.472336] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 already deleted. [ 685.472336] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.669214] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d777850f-4bcd-420d-ab88-295134770a5c in Status: SUCCESS [ 685.669443] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d777850f-4bcd-420d-ab88-295134770a5c deletion is rescheduled due to dependency. [ 685.669570] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.956894] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.957054] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.957119] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.957441] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.957441] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.957544] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32ff0aad-cfa5-4379-8483-9c7077a46f10 is going to be created. [ 685.973042] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.973242] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.973361] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.973629] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.973768] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.973918] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 21ae3397-1891-4784-8453-551b53f732f8 not found, creating... [ 685.974194] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.974345] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.974455] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.974868] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.975103] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.975392] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.975543] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.975652] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.975890] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.976069] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.976314] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 21ae3397-1891-4784-8453-551b53f732f8 is going to be created. [ 685.984812] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.985107] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.985262] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.985577] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.985844] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.005571] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32ff0aad-cfa5-4379-8483-9c7077a46f10 in Status: UNINITIALIZED for 2s [ 686.006972] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.007301] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.007522] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.007925] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.008424] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.008756] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-21ae3397-1891-4784-8453-551b53f732f8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.813176] env[66502]: INFO networking_nsxv3.common.synchronization [req-3ba4b262-9df4-4cd1-8f44-afa597ba05b2 req-04dbdd10-ddac-47ed-b45f-ea32d596dba7 service nova] Enqueued Resource ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 with Priority: HIGHEST for action security_group_rules [ 686.813484] env[66502]: INFO networking_nsxv3.common.synchronization [req-3ba4b262-9df4-4cd1-8f44-afa597ba05b2 req-04dbdd10-ddac-47ed-b45f-ea32d596dba7 service nova] Enqueued Resource ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 with Priority: HIGHEST for action security_group_members [ 686.813583] env[66502]: INFO networking_nsxv3.common.synchronization [req-3ba4b262-9df4-4cd1-8f44-afa597ba05b2 req-04dbdd10-ddac-47ed-b45f-ea32d596dba7 service nova] Enqueued Resource ID: 21ae3397-1891-4784-8453-551b53f732f8 with Priority: HIGHEST for action port [ 686.814197] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 with Priority: HIGHEST for action security_group_rules [ 686.815244] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 with Priority: HIGHEST for action security_group_members [ 686.815342] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 21ae3397-1891-4784-8453-551b53f732f8 with Priority: HIGHEST for action port [ 686.815667] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.815802] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.815869] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.816121] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.816241] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ab1d50c-f5a6-4aaf-829b-d0cfdf164722',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.817278] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.817430] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.817524] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.817749] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.817988] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.821041] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.821041] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.821041] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.821041] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.821211] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ab1d50c-f5a6-4aaf-829b-d0cfdf164722',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.822464] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-21ae3397-1891-4784-8453-551b53f732f8 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.822630] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-21ae3397-1891-4784-8453-551b53f732f8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.822732] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-21ae3397-1891-4784-8453-551b53f732f8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.823052] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-21ae3397-1891-4784-8453-551b53f732f8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.823188] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('21ae3397-1891-4784-8453-551b53f732f8',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.827347] env[66502]: INFO networking_nsxv3.common.synchronization [req-30f9b209-b854-4046-a5e4-a2d88cac8413 req-ec0ddd60-c0c8-4cce-b993-826ec2bc9fa7 tempest-SecurityGroupRulesNegativeTestJSON-95779080 tempest-SecurityGroupRulesNegativeTestJSON-95779080-project-member] Enqueued Resource ID: 34a2e2db-10ba-47ce-ae89-7d9385216043 with Priority: HIGHEST for action security_group_rules [ 686.828124] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34a2e2db-10ba-47ce-ae89-7d9385216043 with Priority: HIGHEST for action security_group_rules [ 686.828486] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34a2e2db-10ba-47ce-ae89-7d9385216043 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.828647] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34a2e2db-10ba-47ce-ae89-7d9385216043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.828721] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34a2e2db-10ba-47ce-ae89-7d9385216043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.829081] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34a2e2db-10ba-47ce-ae89-7d9385216043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.829081] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34a2e2db-10ba-47ce-ae89-7d9385216043',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.326476] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.326643] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.326826] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8ab1d50c-f5a6-4aaf-829b-d0cfdf164722',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.330042] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 21ae3397-1891-4784-8453-551b53f732f8 with status ACTIVE [ 687.330278] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.330403] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.330485] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.330700] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.330790] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.330964] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.331076] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.333224] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.333474] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.333567] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.333797] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.333913] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.333978] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.334157] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.334339] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.334339] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 21ae3397-1891-4784-8453-551b53f732f8 is going to be updated. [ 687.362403] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.362703] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.362828] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.363211] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.363416] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.363633] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-21ae3397-1891-4784-8453-551b53f732f8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.365214] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.365337] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.365393] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.365584] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.365686] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.365782] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34a2e2db-10ba-47ce-ae89-7d9385216043 already deleted. [ 687.365867] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34a2e2db-10ba-47ce-ae89-7d9385216043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.419216] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e12852c1-7dc2-4ed2-bd34-e396f9f9256d in Status: SUCCESS [ 687.419216] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.419216] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.419402] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.419632] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.419753] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.419817] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.419973] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.420071] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.420159] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.420249] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e12852c1-7dc2-4ed2-bd34-e396f9f9256d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.539012] env[66502]: INFO networking_nsxv3.common.synchronization [req-dff97351-b363-4210-ba79-c321997a6bcb req-086f74c9-a568-4915-984a-e88cfeea67f7 tempest-ImagesOneServerNegativeTestJSON-1621881971 tempest-ImagesOneServerNegativeTestJSON-1621881971-project-member] Enqueued Resource ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 with Priority: HIGHEST for action security_group_members [ 687.539707] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 with Priority: HIGHEST for action security_group_members [ 687.540020] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.540166] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.540239] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.540438] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.540588] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.540681] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.540742] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.540929] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.541073] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.541180] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ddb3b9a8-c63d-4123-aa7f-cbf2b5279231',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.653565] env[66502]: INFO networking_nsxv3.common.synchronization [req-f770ee72-9d2f-4345-bb58-3fa358fb19f3 req-8ace8250-32bd-4c5e-9469-5c6471666846 tempest-ServerDiagnosticsNegativeTest-2130973331 tempest-ServerDiagnosticsNegativeTest-2130973331-project-member] Enqueued Resource ID: 9f4a2c28-0514-4b56-8107-7969d0d9335c with Priority: HIGHEST for action security_group_members [ 687.653755] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f4a2c28-0514-4b56-8107-7969d0d9335c with Priority: HIGHEST for action security_group_members [ 687.654119] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f4a2c28-0514-4b56-8107-7969d0d9335c taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.654197] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f4a2c28-0514-4b56-8107-7969d0d9335c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.654292] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f4a2c28-0514-4b56-8107-7969d0d9335c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.654505] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f4a2c28-0514-4b56-8107-7969d0d9335c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.654663] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.654788] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.654854] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.655017] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.655317] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.655494] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f4a2c28-0514-4b56-8107-7969d0d9335c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.837200] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8ab1d50c-f5a6-4aaf-829b-d0cfdf164722',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.923517] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.923908] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.924109] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.924449] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.924643] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.924909] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.925091] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.925363] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.925586] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.925586] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.925704] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.925867] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.925867] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.926041] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.926147] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.926230] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.926288] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.926451] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.926499] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.926570] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.926659] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e12852c1-7dc2-4ed2-bd34-e396f9f9256d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.018928] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32ff0aad-cfa5-4379-8483-9c7077a46f10 in Status: SUCCESS [ 688.019173] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32ff0aad-cfa5-4379-8483-9c7077a46f10" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.019339] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32ff0aad-cfa5-4379-8483-9c7077a46f10" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.019571] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32ff0aad-cfa5-4379-8483-9c7077a46f10" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.019799] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.019967] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.020065] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.020249] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.020355] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.020447] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32ff0aad-cfa5-4379-8483-9c7077a46f10" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.020542] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('32ff0aad-cfa5-4379-8483-9c7077a46f10',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.043519] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.043714] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.043816] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.044125] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.044249] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.044524] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.044661] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.044747] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.044947] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.045059] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.045180] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 is going to be updated. [ 688.082422] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.082422] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.082666] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.082666] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.082819] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.098679] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-670 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.098873] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.098999] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.099287] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.099553] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.099697] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.099804] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.100025] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.100168] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.100365] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 688.100470] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 688.100564] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 688.100690] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 688.100905] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 688.100905] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 688.100999] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 688.102691] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 in Status: IN_PROGRESS for 2s [ 688.129718] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 688.129917] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 688.130196] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 688.132670] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.132670] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-2fa86dac-99c1-4d22-851e-1f307b6d219d taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.132670] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-2fa86dac-99c1-4d22-851e-1f307b6d219d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.132670] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-2fa86dac-99c1-4d22-851e-1f307b6d219d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.132670] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-2fa86dac-99c1-4d22-851e-1f307b6d219d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.132670] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fa86dac-99c1-4d22-851e-1f307b6d219d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.159925] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.159925] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.159925] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.159925] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.159925] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.159925] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.159925] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.159925] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.159925] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.159925] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.159925] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f4a2c28-0514-4b56-8107-7969d0d9335c already deleted. [ 688.159925] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f4a2c28-0514-4b56-8107-7969d0d9335c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.342076] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.342076] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.342076] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.342076] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.342076] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.342076] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 is going to be created. [ 688.385065] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.385065] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.385065] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.385065] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.385065] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.395141] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 in Status: UNINITIALIZED for 2s [ 688.430552] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e12852c1-7dc2-4ed2-bd34-e396f9f9256d: rpc.has_security_group_logging(os_id): False [ 688.452326] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.452326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.452326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.452326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.452326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.452326] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.452326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.452326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.452326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.452326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.452326] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.452326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.452326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.452326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.452326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.452792] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.452792] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.452792] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.452792] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.452792] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.452792] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e12852c1-7dc2-4ed2-bd34-e396f9f9256d is going to be updated. [ 688.522606] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.522763] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.522826] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.523180] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.523312] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.525938] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-32ff0aad-cfa5-4379-8483-9c7077a46f10 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.525938] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32ff0aad-cfa5-4379-8483-9c7077a46f10" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.525938] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32ff0aad-cfa5-4379-8483-9c7077a46f10" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.525938] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32ff0aad-cfa5-4379-8483-9c7077a46f10" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.525938] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.525938] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.525938] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.525938] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.525938] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.526236] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32ff0aad-cfa5-4379-8483-9c7077a46f10" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.526236] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-32ff0aad-cfa5-4379-8483-9c7077a46f10 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.526295] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32ff0aad-cfa5-4379-8483-9c7077a46f10" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.526323] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32ff0aad-cfa5-4379-8483-9c7077a46f10" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.526883] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32ff0aad-cfa5-4379-8483-9c7077a46f10" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.526883] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.527514] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.527514] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.527514] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.527514] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.527514] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32ff0aad-cfa5-4379-8483-9c7077a46f10" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.527725] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('32ff0aad-cfa5-4379-8483-9c7077a46f10',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.562878] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e12852c1-7dc2-4ed2-bd34-e396f9f9256d in Status: IN_PROGRESS for 2s [ 688.635099] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.635531] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.635720] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.636044] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.636265] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.636431] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 2fa86dac-99c1-4d22-851e-1f307b6d219d not found, creating... [ 688.636726] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.636905] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.637026] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.637395] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.637497] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.637874] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.638098] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.638285] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.638614] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.638810] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.639048] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 2fa86dac-99c1-4d22-851e-1f307b6d219d is going to be created. [ 688.672400] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.672400] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.672400] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.672400] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.672400] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.672400] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-2fa86dac-99c1-4d22-851e-1f307b6d219d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.031257] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 32ff0aad-cfa5-4379-8483-9c7077a46f10: rpc.has_security_group_logging(os_id): False [ 689.052300] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.052455] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.052529] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.052748] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.052841] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.053077] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.053182] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.053246] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.053402] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.053479] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.053664] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.053755] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.053816] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.053952] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.054047] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.054233] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.054326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.054397] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.054539] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.054614] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.054696] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32ff0aad-cfa5-4379-8483-9c7077a46f10 is going to be created. [ 689.136804] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.136804] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.136804] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.136804] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.136804] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.148112] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32ff0aad-cfa5-4379-8483-9c7077a46f10 in Status: IN_PROGRESS for 2s [ 689.404464] env[66502]: INFO networking_nsxv3.common.synchronization [req-f770ee72-9d2f-4345-bb58-3fa358fb19f3 req-6f89893e-4dd1-4a6c-a63b-fdb1a365d396 service nova] Enqueued Resource ID: 9f4a2c28-0514-4b56-8107-7969d0d9335c with Priority: HIGHEST for action security_group_rules [ 689.404464] env[66502]: INFO networking_nsxv3.common.synchronization [req-f770ee72-9d2f-4345-bb58-3fa358fb19f3 req-6f89893e-4dd1-4a6c-a63b-fdb1a365d396 service nova] Enqueued Resource ID: 9f4a2c28-0514-4b56-8107-7969d0d9335c with Priority: HIGHEST for action security_group_members [ 689.404464] env[66502]: INFO networking_nsxv3.common.synchronization [req-f770ee72-9d2f-4345-bb58-3fa358fb19f3 req-6f89893e-4dd1-4a6c-a63b-fdb1a365d396 service nova] Enqueued Resource ID: 2fa86dac-99c1-4d22-851e-1f307b6d219d with Priority: HIGHEST for action port [ 689.404464] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f4a2c28-0514-4b56-8107-7969d0d9335c with Priority: HIGHEST for action security_group_rules [ 689.404464] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f4a2c28-0514-4b56-8107-7969d0d9335c with Priority: HIGHEST for action security_group_members [ 689.404464] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fa86dac-99c1-4d22-851e-1f307b6d219d with Priority: HIGHEST for action port [ 689.404464] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f4a2c28-0514-4b56-8107-7969d0d9335c taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.404464] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f4a2c28-0514-4b56-8107-7969d0d9335c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.404464] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f4a2c28-0514-4b56-8107-7969d0d9335c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.404464] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f4a2c28-0514-4b56-8107-7969d0d9335c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.404464] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f4a2c28-0514-4b56-8107-7969d0d9335c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.405345] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f4a2c28-0514-4b56-8107-7969d0d9335c taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.405420] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f4a2c28-0514-4b56-8107-7969d0d9335c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.405462] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f4a2c28-0514-4b56-8107-7969d0d9335c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.405713] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f4a2c28-0514-4b56-8107-7969d0d9335c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.405890] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.406015] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.406080] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.406255] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.406352] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.406454] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f4a2c28-0514-4b56-8107-7969d0d9335c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.407392] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-2fa86dac-99c1-4d22-851e-1f307b6d219d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.407538] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2fa86dac-99c1-4d22-851e-1f307b6d219d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.407602] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2fa86dac-99c1-4d22-851e-1f307b6d219d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.407765] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2fa86dac-99c1-4d22-851e-1f307b6d219d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.407842] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fa86dac-99c1-4d22-851e-1f307b6d219d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.910122] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f4a2c28-0514-4b56-8107-7969d0d9335c taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.910122] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f4a2c28-0514-4b56-8107-7969d0d9335c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.911824] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f4a2c28-0514-4b56-8107-7969d0d9335c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.911824] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2fa86dac-99c1-4d22-851e-1f307b6d219d with status ACTIVE [ 689.912565] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.912565] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.912565] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.912565] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.912728] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.912794] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.912876] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.912935] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.913106] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.913189] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.913371] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.913660] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.913660] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.913660] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.913760] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.913834] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2fa86dac-99c1-4d22-851e-1f307b6d219d is going to be updated. [ 689.942840] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.942840] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.942840] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.942840] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.942840] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.942840] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2fa86dac-99c1-4d22-851e-1f307b6d219d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.102691] env[66502]: INFO networking_nsxv3.common.synchronization [req-cf045099-d678-4906-9db6-cb37f6852ced req-dbd0bbb2-910e-4058-8728-5ea89237ea53 tempest-DeleteServersAdminTestJSON-418815838 tempest-DeleteServersAdminTestJSON-418815838-project-member] Enqueued Resource ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 with Priority: HIGHEST for action security_group_members [ 690.103324] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 with Priority: HIGHEST for action security_group_members [ 690.104636] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-67c97dc5-9d08-4219-aa00-0b83a223ae57 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.104636] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.104636] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.104891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.104919] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.105068] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.105128] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.105298] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.105374] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.105458] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('67c97dc5-9d08-4219-aa00-0b83a223ae57',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.115640] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 in Status: SUCCESS [ 690.115850] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 deletion is rescheduled due to dependency. [ 690.116431] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.407781] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 in Status: SUCCESS [ 690.408566] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.408986] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.409347] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.409617] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.409844] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.410014] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.410282] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.410628] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.410803] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.411046] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8ab1d50c-f5a6-4aaf-829b-d0cfdf164722',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.415748] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f4a2c28-0514-4b56-8107-7969d0d9335c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.555126] env[66502]: INFO networking_nsxv3.common.synchronization [req-16b648ca-5f33-42bb-8c4c-24b6d07b2770 req-0bdd33d1-0155-452a-b26c-12f17e86c549 tempest-ServersNegativeTestJSON-1444377316 tempest-ServersNegativeTestJSON-1444377316-project-member] Enqueued Resource ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a with Priority: HIGHEST for action security_group_members [ 690.556040] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a with Priority: HIGHEST for action security_group_members [ 690.556040] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ee12fee-49b0-4d1d-b52d-29888a355e8a taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.556307] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.556307] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.556432] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.559309] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.559441] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.559508] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.559704] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.559795] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.559889] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ee12fee-49b0-4d1d-b52d-29888a355e8a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.584480] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: e12852c1-7dc2-4ed2-bd34-e396f9f9256d in Status: SUCCESS [ 690.584480] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.609751] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.609751] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.609751] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.609751] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.609751] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.609937] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.609937] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.610017] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.610296] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.610296] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.610296] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 is going to be updated. [ 690.649691] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.649825] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.649899] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.650376] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.650376] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.660531] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 in Status: IN_PROGRESS for 2s [ 690.913962] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8ab1d50c-f5a6-4aaf-829b-d0cfdf164722',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.919176] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.919332] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.919332] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.919725] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.919725] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.919725] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f4a2c28-0514-4b56-8107-7969d0d9335c is going to be created. [ 690.948983] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.949318] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.949318] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.949527] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.949653] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.040082] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f4a2c28-0514-4b56-8107-7969d0d9335c in Status: UNINITIALIZED for 2s [ 691.059749] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-431 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.060055] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-431" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.060149] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-431" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.060584] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-431" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.060844] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.061039] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.061119] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.061542] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.061542] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.061661] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 691.062667] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 691.062667] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 691.062667] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 691.062667] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 691.062667] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 691.062667] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 691.064066] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.064689] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.064689] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.064689] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.064689] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.064689] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.065402] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.065402] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.065402] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.065402] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.065402] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a already deleted. [ 691.065402] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.089097] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 691.089277] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 691.089433] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 691.089644] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-431" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.090314] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-fe23f065-e476-40d6-9fef-64739fe044f6 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.090505] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-fe23f065-e476-40d6-9fef-64739fe044f6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.090623] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-fe23f065-e476-40d6-9fef-64739fe044f6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.090956] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-fe23f065-e476-40d6-9fef-64739fe044f6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.091113] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe23f065-e476-40d6-9fef-64739fe044f6',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.162811] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 32ff0aad-cfa5-4379-8483-9c7077a46f10 in Status: SUCCESS [ 691.163368] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32ff0aad-cfa5-4379-8483-9c7077a46f10" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.416869] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722: rpc.has_security_group_logging(os_id): False [ 691.440660] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.442470] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.442470] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.442470] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.442470] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.442470] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.442470] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.442470] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.442470] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.442470] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.442470] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 is going to be created. [ 691.521534] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.521743] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.521826] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.522147] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.522383] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.537162] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 in Status: IN_PROGRESS for 2s [ 691.594338] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.594547] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.594661] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.594943] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.595114] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.595266] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port fe23f065-e476-40d6-9fef-64739fe044f6 not found, creating... [ 691.595589] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.595651] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.595762] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.596539] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.596539] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.596539] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.596539] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.596736] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.596845] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.596968] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.597114] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: fe23f065-e476-40d6-9fef-64739fe044f6 is going to be created. [ 691.639729] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.639957] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.640036] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.640354] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.640581] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.640815] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-fe23f065-e476-40d6-9fef-64739fe044f6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.321799] env[66502]: INFO networking_nsxv3.common.synchronization [req-16b648ca-5f33-42bb-8c4c-24b6d07b2770 req-726ec15c-d586-4bad-af90-25cd1e5ad124 service nova] Enqueued Resource ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a with Priority: HIGHEST for action security_group_rules [ 692.321799] env[66502]: INFO networking_nsxv3.common.synchronization [req-16b648ca-5f33-42bb-8c4c-24b6d07b2770 req-726ec15c-d586-4bad-af90-25cd1e5ad124 service nova] Enqueued Resource ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a with Priority: HIGHEST for action security_group_members [ 692.321799] env[66502]: INFO networking_nsxv3.common.synchronization [req-16b648ca-5f33-42bb-8c4c-24b6d07b2770 req-726ec15c-d586-4bad-af90-25cd1e5ad124 service nova] Enqueued Resource ID: fe23f065-e476-40d6-9fef-64739fe044f6 with Priority: HIGHEST for action port [ 692.322199] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a with Priority: HIGHEST for action security_group_rules [ 692.322199] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a with Priority: HIGHEST for action security_group_members [ 692.322199] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe23f065-e476-40d6-9fef-64739fe044f6 with Priority: HIGHEST for action port [ 692.322810] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ee12fee-49b0-4d1d-b52d-29888a355e8a taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.322971] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.323303] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.323660] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.323710] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ee12fee-49b0-4d1d-b52d-29888a355e8a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.325582] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ee12fee-49b0-4d1d-b52d-29888a355e8a taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.325582] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.325582] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.325582] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.325582] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.325582] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.325582] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.325582] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.325582] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.325582] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ee12fee-49b0-4d1d-b52d-29888a355e8a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.326382] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe23f065-e476-40d6-9fef-64739fe044f6 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.326805] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe23f065-e476-40d6-9fef-64739fe044f6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.327142] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe23f065-e476-40d6-9fef-64739fe044f6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.327142] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe23f065-e476-40d6-9fef-64739fe044f6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.327194] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe23f065-e476-40d6-9fef-64739fe044f6',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.672200] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 in Status: SUCCESS [ 692.672267] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 deletion is rescheduled due to dependency. [ 692.672382] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.693649] env[66502]: INFO networking_nsxv3.common.synchronization [req-8ba315dd-ad86-4dd0-9f74-8ca9ec98ac9a req-66ca1999-cd7e-4b83-b3ba-154e84076d3b tempest-ServerMetadataTestJSON-68704275 tempest-ServerMetadataTestJSON-68704275-project-member] Enqueued Resource ID: b1dbab98-9c58-424b-aadb-07860f808828 with Priority: HIGHEST for action security_group_members [ 692.694248] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1dbab98-9c58-424b-aadb-07860f808828 with Priority: HIGHEST for action security_group_members [ 692.695349] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b1dbab98-9c58-424b-aadb-07860f808828 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.695349] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b1dbab98-9c58-424b-aadb-07860f808828" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.695349] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b1dbab98-9c58-424b-aadb-07860f808828" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.695349] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b1dbab98-9c58-424b-aadb-07860f808828" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.695349] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.695349] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.695349] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.695636] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.695636] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.695636] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b1dbab98-9c58-424b-aadb-07860f808828',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.830549] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ee12fee-49b0-4d1d-b52d-29888a355e8a taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.830690] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.830881] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ee12fee-49b0-4d1d-b52d-29888a355e8a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.831792] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fe23f065-e476-40d6-9fef-64739fe044f6 with status ACTIVE [ 692.832160] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.832290] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.832290] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.832473] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.832562] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.832739] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.832838] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.832933] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.833084] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.833165] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.833348] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.833443] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.833504] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.833645] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.833721] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.833800] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fe23f065-e476-40d6-9fef-64739fe044f6 is going to be updated. [ 692.865940] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.867152] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.867278] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.867536] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.867937] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.868606] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe23f065-e476-40d6-9fef-64739fe044f6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.053521] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f4a2c28-0514-4b56-8107-7969d0d9335c in Status: SUCCESS [ 693.053800] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f4a2c28-0514-4b56-8107-7969d0d9335c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.056579] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f4a2c28-0514-4b56-8107-7969d0d9335c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.056854] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f4a2c28-0514-4b56-8107-7969d0d9335c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.057089] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.057251] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.057302] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.057484] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.057601] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.057709] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f4a2c28-0514-4b56-8107-7969d0d9335c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.057842] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f4a2c28-0514-4b56-8107-7969d0d9335c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.198029] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.198029] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.198029] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.199305] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.199305] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.199305] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.199618] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.199870] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.200551] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.200732] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.200907] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1dbab98-9c58-424b-aadb-07860f808828 is going to be updated. [ 693.236895] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.237133] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.237245] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.237587] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.237789] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.251601] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1dbab98-9c58-424b-aadb-07860f808828 in Status: IN_PROGRESS for 2s [ 693.336290] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ee12fee-49b0-4d1d-b52d-29888a355e8a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.557992] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 in Status: SUCCESS [ 693.558305] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.561320] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f4a2c28-0514-4b56-8107-7969d0d9335c taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.561557] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f4a2c28-0514-4b56-8107-7969d0d9335c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.561672] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f4a2c28-0514-4b56-8107-7969d0d9335c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.562279] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f4a2c28-0514-4b56-8107-7969d0d9335c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.562417] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.562541] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.562655] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.562901] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.563132] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.563193] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f4a2c28-0514-4b56-8107-7969d0d9335c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.563428] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f4a2c28-0514-4b56-8107-7969d0d9335c taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.563576] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f4a2c28-0514-4b56-8107-7969d0d9335c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.563685] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f4a2c28-0514-4b56-8107-7969d0d9335c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.563909] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f4a2c28-0514-4b56-8107-7969d0d9335c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.565295] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.565295] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.565429] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.565652] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.565800] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.565945] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f4a2c28-0514-4b56-8107-7969d0d9335c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.566310] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f4a2c28-0514-4b56-8107-7969d0d9335c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.845336] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.845336] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.845336] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.845336] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.845336] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.845336] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a is going to be created. [ 693.877662] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.877954] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.878129] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.878455] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.878689] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.895942] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a in Status: UNINITIALIZED for 2s [ 694.072921] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f4a2c28-0514-4b56-8107-7969d0d9335c: rpc.has_security_group_logging(os_id): False [ 694.092614] env[66502]: INFO networking_nsxv3.common.synchronization [None req-1226057d-56e2-49b1-8bd9-524bd58fb59f None None] Enqueued Resource ID: fb0b390a-71c9-4edd-8ecc-02dc85880ae1 with Priority: HIGHEST for action port [ 694.093417] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb0b390a-71c9-4edd-8ecc-02dc85880ae1 with Priority: HIGHEST for action port [ 694.095398] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.095398] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.097962] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.098269] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.098427] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.098681] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.099501] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.099501] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.099501] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.099501] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.099501] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.099822] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.099822] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.099932] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.100042] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.100263] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.100382] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.100459] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.100631] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.100725] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.100827] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f4a2c28-0514-4b56-8107-7969d0d9335c is going to be created. [ 694.102073] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-fb0b390a-71c9-4edd-8ecc-02dc85880ae1 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.104710] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fb0b390a-71c9-4edd-8ecc-02dc85880ae1" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.104710] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fb0b390a-71c9-4edd-8ecc-02dc85880ae1" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.104710] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fb0b390a-71c9-4edd-8ecc-02dc85880ae1" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.104710] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fb0b390a-71c9-4edd-8ecc-02dc85880ae1',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.200281] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.200427] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.200500] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.200723] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.200906] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.215786] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f4a2c28-0514-4b56-8107-7969d0d9335c in Status: IN_PROGRESS for 2s [ 694.605271] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fb0b390a-71c9-4edd-8ecc-02dc85880ae1 [ 694.605493] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.605738] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.606268] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.606801] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.606801] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.607340] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fb0b390a-71c9-4edd-8ecc-02dc85880ae1 already deleted. [ 694.607340] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fb0b390a-71c9-4edd-8ecc-02dc85880ae1" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.262427] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b1dbab98-9c58-424b-aadb-07860f808828 in Status: SUCCESS [ 695.262619] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b1dbab98-9c58-424b-aadb-07860f808828 deletion is rescheduled due to dependency. [ 695.262773] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b1dbab98-9c58-424b-aadb-07860f808828" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.911762] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a in Status: SUCCESS [ 695.912125] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.912180] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.913288] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.913288] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.913288] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.913288] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.913605] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.913605] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.913605] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.913721] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ee12fee-49b0-4d1d-b52d-29888a355e8a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.070088] env[66502]: INFO networking_nsxv3.common.synchronization [None req-57e3457a-c68c-47bc-aba3-b86689af34f9 tempest-ServerActionsV293TestJSON-1501321181 tempest-ServerActionsV293TestJSON-1501321181-project-member] Enqueued Resource ID: 05164d98-30c1-459b-9f4c-ac294382c57e with Priority: HIGHEST for action security_group_rules [ 696.070583] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05164d98-30c1-459b-9f4c-ac294382c57e with Priority: HIGHEST for action security_group_rules [ 696.070893] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05164d98-30c1-459b-9f4c-ac294382c57e taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.071041] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05164d98-30c1-459b-9f4c-ac294382c57e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.072804] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05164d98-30c1-459b-9f4c-ac294382c57e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.072804] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05164d98-30c1-459b-9f4c-ac294382c57e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.072804] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05164d98-30c1-459b-9f4c-ac294382c57e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.172580] env[66502]: INFO networking_nsxv3.common.synchronization [None req-26d1328b-7525-4ebe-b3e1-9d4f916fad47 tempest-ServerActionsV293TestJSON-1501321181 tempest-ServerActionsV293TestJSON-1501321181-project-member] Enqueued Resource ID: 05164d98-30c1-459b-9f4c-ac294382c57e with Priority: HIGHEST for action security_group_rules [ 696.173176] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05164d98-30c1-459b-9f4c-ac294382c57e with Priority: HIGHEST for action security_group_rules [ 696.173588] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05164d98-30c1-459b-9f4c-ac294382c57e taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.173588] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05164d98-30c1-459b-9f4c-ac294382c57e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.229357] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f4a2c28-0514-4b56-8107-7969d0d9335c in Status: SUCCESS [ 696.229624] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f4a2c28-0514-4b56-8107-7969d0d9335c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.418692] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ee12fee-49b0-4d1d-b52d-29888a355e8a taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.418692] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.418692] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.418692] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.418692] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.418692] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.418692] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.419133] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.419133] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.419133] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.419133] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ee12fee-49b0-4d1d-b52d-29888a355e8a taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.419334] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.419334] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.419398] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.419535] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.419599] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.419636] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.419754] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.419829] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.419909] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.420118] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ee12fee-49b0-4d1d-b52d-29888a355e8a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.601153] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.603032] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.603032] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.603032] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.603032] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.603032] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05164d98-30c1-459b-9f4c-ac294382c57e already deleted. [ 696.603032] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05164d98-30c1-459b-9f4c-ac294382c57e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.603032] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05164d98-30c1-459b-9f4c-ac294382c57e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.606765] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05164d98-30c1-459b-9f4c-ac294382c57e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.606765] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05164d98-30c1-459b-9f4c-ac294382c57e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.924329] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ee12fee-49b0-4d1d-b52d-29888a355e8a: rpc.has_security_group_logging(os_id): False [ 696.946553] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.946715] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.946762] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.946962] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.947058] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.947246] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.947339] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.947399] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.947546] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.947617] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.947812] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.947901] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.947958] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.948119] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.948190] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.948358] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.948445] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.948501] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.948640] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.948704] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.948779] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a is going to be created. [ 697.027324] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.027324] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.027324] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.027324] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.027324] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.044390] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a in Status: IN_PROGRESS for 2s [ 697.129156] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.129156] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.129156] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.129653] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.129759] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.129911] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05164d98-30c1-459b-9f4c-ac294382c57e already deleted. [ 697.130018] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05164d98-30c1-459b-9f4c-ac294382c57e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.276031] env[66502]: INFO networking_nsxv3.common.synchronization [req-f7e82c5e-a4af-433a-b8f5-a34825178777 req-e62ff43c-8135-4387-bb8b-a5fe9b7ac883 tempest-ServersTestManualDisk-1208375570 tempest-ServersTestManualDisk-1208375570-project-member] Enqueued Resource ID: 2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49 with Priority: HIGHEST for action security_group_members [ 697.276031] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49 with Priority: HIGHEST for action security_group_members [ 697.276031] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.276031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.276031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.276031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.276031] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.276031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.276031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.276031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.276031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.276031] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.736572] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-251 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.736759] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-251" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.736926] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-251" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.737282] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-251" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.737543] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.737691] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.737799] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.738459] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.739024] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.739509] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 697.739623] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 697.739877] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 697.740097] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 697.740625] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 697.740796] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 697.741069] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 697.766799] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 697.768345] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 697.768345] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 697.768345] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-251" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.768345] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-3af5f73e-20e9-4bb5-83d8-f5e0cc2f7098 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.768779] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-3af5f73e-20e9-4bb5-83d8-f5e0cc2f7098" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.768779] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-3af5f73e-20e9-4bb5-83d8-f5e0cc2f7098" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.769098] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-3af5f73e-20e9-4bb5-83d8-f5e0cc2f7098" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.769182] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3af5f73e-20e9-4bb5-83d8-f5e0cc2f7098',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 697.778794] env[66502]: INFO networking_nsxv3.common.synchronization [None req-9ee99f49-0b1a-4aeb-97d6-508e76ab64d4 None None] Enqueued Resource ID: 9ce841ca-4744-4bd1-92f2-6f6643843c70 with Priority: HIGHEST for action port [ 697.779313] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.779495] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.779552] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.779778] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.779885] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.780093] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.780214] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.780292] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.780548] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.780548] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.780639] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49 already deleted. [ 697.780727] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 697.781237] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ce841ca-4744-4bd1-92f2-6f6643843c70 with Priority: HIGHEST for action port [ 697.781596] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-9ce841ca-4744-4bd1-92f2-6f6643843c70 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 697.782031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9ce841ca-4744-4bd1-92f2-6f6643843c70" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 697.782031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9ce841ca-4744-4bd1-92f2-6f6643843c70" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 697.782031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9ce841ca-4744-4bd1-92f2-6f6643843c70" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 697.782181] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9ce841ca-4744-4bd1-92f2-6f6643843c70',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.272359] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.272774] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.272894] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.273321] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.273545] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.273769] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port 3af5f73e-20e9-4bb5-83d8-f5e0cc2f7098 not found, creating... [ 698.274198] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.274442] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.274622] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.274953] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.277481] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.277481] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.277481] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.277481] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.277481] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.277481] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.280438] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: 3af5f73e-20e9-4bb5-83d8-f5e0cc2f7098 is going to be created. [ 698.284475] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9ce841ca-4744-4bd1-92f2-6f6643843c70 [ 698.284739] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.284899] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.284972] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.285721] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.285721] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.285721] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9ce841ca-4744-4bd1-92f2-6f6643843c70 already deleted. [ 698.285721] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9ce841ca-4744-4bd1-92f2-6f6643843c70" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.306925] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.307258] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.307387] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.307689] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.307922] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.308179] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-3af5f73e-20e9-4bb5-83d8-f5e0cc2f7098" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.025020] env[66502]: INFO networking_nsxv3.common.synchronization [req-f7e82c5e-a4af-433a-b8f5-a34825178777 req-59f01415-8b7a-48ca-ad61-6dd5114dadfc service nova] Enqueued Resource ID: 2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49 with Priority: HIGHEST for action security_group_rules [ 699.025020] env[66502]: INFO networking_nsxv3.common.synchronization [req-f7e82c5e-a4af-433a-b8f5-a34825178777 req-59f01415-8b7a-48ca-ad61-6dd5114dadfc service nova] Enqueued Resource ID: 2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49 with Priority: HIGHEST for action security_group_members [ 699.025020] env[66502]: INFO networking_nsxv3.common.synchronization [req-f7e82c5e-a4af-433a-b8f5-a34825178777 req-59f01415-8b7a-48ca-ad61-6dd5114dadfc service nova] Enqueued Resource ID: 3af5f73e-20e9-4bb5-83d8-f5e0cc2f7098 with Priority: HIGHEST for action port [ 699.025020] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49 with Priority: HIGHEST for action security_group_rules [ 699.025020] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49 with Priority: HIGHEST for action security_group_members [ 699.025020] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3af5f73e-20e9-4bb5-83d8-f5e0cc2f7098 with Priority: HIGHEST for action port [ 699.025020] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.025020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.025020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.025724] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.025948] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.033456] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.033456] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.033456] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.033456] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.033456] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.033456] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.033456] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.033456] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.033456] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.033456] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.033456] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-3af5f73e-20e9-4bb5-83d8-f5e0cc2f7098 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.033456] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3af5f73e-20e9-4bb5-83d8-f5e0cc2f7098" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.033456] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3af5f73e-20e9-4bb5-83d8-f5e0cc2f7098" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.033456] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3af5f73e-20e9-4bb5-83d8-f5e0cc2f7098" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.033456] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3af5f73e-20e9-4bb5-83d8-f5e0cc2f7098',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.055768] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a in Status: SUCCESS [ 699.055977] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.166253] env[66502]: INFO networking_nsxv3.common.synchronization [req-e265ee7a-c987-4035-9aef-97b30a3cbd09 req-23fec03a-25fd-45f0-8ad9-3614136dbbc7 tempest-VolumesAssistedSnapshotsTest-591155639 tempest-VolumesAssistedSnapshotsTest-591155639-project-member] Enqueued Resource ID: bb24e830-31ca-4b75-ba92-3835430fbf29 with Priority: HIGHEST for action security_group_members [ 699.166786] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb24e830-31ca-4b75-ba92-3835430fbf29 with Priority: HIGHEST for action security_group_members [ 699.168174] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-bb24e830-31ca-4b75-ba92-3835430fbf29 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.168731] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bb24e830-31ca-4b75-ba92-3835430fbf29" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.168731] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bb24e830-31ca-4b75-ba92-3835430fbf29" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.168731] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bb24e830-31ca-4b75-ba92-3835430fbf29" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.168878] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.168974] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.168974] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.169356] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.169356] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.169356] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bb24e830-31ca-4b75-ba92-3835430fbf29',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.534637] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.534637] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.535964] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.537063] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3af5f73e-20e9-4bb5-83d8-f5e0cc2f7098 with status ACTIVE [ 699.537159] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.537270] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.537862] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.539164] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.539279] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.539560] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.539678] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.539866] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.539944] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.539987] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.540209] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.540311] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.540374] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.540519] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.540594] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.540688] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3af5f73e-20e9-4bb5-83d8-f5e0cc2f7098 is going to be updated. [ 699.572904] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.573159] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.573242] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.573456] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.573603] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.573782] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3af5f73e-20e9-4bb5-83d8-f5e0cc2f7098" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.672042] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.672042] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.672291] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.672369] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.674426] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.674426] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.674426] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.674426] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.674426] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.674426] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.674426] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb24e830-31ca-4b75-ba92-3835430fbf29 is going to be updated. [ 699.727568] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.727980] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.729149] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.730037] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.730037] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.741245] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb24e830-31ca-4b75-ba92-3835430fbf29 in Status: IN_PROGRESS for 2s [ 700.043129] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.117217] env[66502]: INFO networking_nsxv3.common.synchronization [req-150feec1-9624-4a3f-ab0e-062e6c11d860 req-0e72c842-2884-4636-b919-6af018a0692b tempest-ServersV294TestFqdnHostnames-23965797 tempest-ServersV294TestFqdnHostnames-23965797-project-member] Enqueued Resource ID: c7d21481-83aa-4bac-bea4-1030ed0a857b with Priority: HIGHEST for action security_group_members [ 700.117841] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7d21481-83aa-4bac-bea4-1030ed0a857b with Priority: HIGHEST for action security_group_members [ 700.118254] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7d21481-83aa-4bac-bea4-1030ed0a857b taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.118434] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7d21481-83aa-4bac-bea4-1030ed0a857b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.118503] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7d21481-83aa-4bac-bea4-1030ed0a857b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.118777] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7d21481-83aa-4bac-bea4-1030ed0a857b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.120444] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.120444] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.120444] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.120730] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.120855] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.120975] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7d21481-83aa-4bac-bea4-1030ed0a857b',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.534673] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-997 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.534972] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-997" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.535200] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-997" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.535547] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-997" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.535843] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.536102] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.536257] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.536516] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.536692] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.536984] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 700.537077] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 700.538211] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 700.538211] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 700.538211] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 700.538211] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 700.538211] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 700.547142] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.547297] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.547366] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.547757] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.547901] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.548025] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49 is going to be created. [ 700.571026] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 700.571026] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 700.571026] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 700.571026] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-997" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.571026] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-7f79e24a-7fa9-442b-993d-45f98750417a taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.571026] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-7f79e24a-7fa9-442b-993d-45f98750417a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.571026] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-7f79e24a-7fa9-442b-993d-45f98750417a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.571026] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-7f79e24a-7fa9-442b-993d-45f98750417a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.572185] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f79e24a-7fa9-442b-993d-45f98750417a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.587226] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.587226] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.587226] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.587226] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.587226] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.601670] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49 in Status: UNINITIALIZED for 2s [ 700.625216] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.625344] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.626447] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.626447] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.626447] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.626447] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.626447] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.626447] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.626447] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.626759] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.626759] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7d21481-83aa-4bac-bea4-1030ed0a857b already deleted. [ 700.626759] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7d21481-83aa-4bac-bea4-1030ed0a857b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.075672] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.075956] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.075956] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.076303] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.076615] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.076713] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port 7f79e24a-7fa9-442b-993d-45f98750417a not found, creating... [ 701.076976] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.077154] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.077291] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.077547] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.077712] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.078020] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.078391] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.078575] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.078962] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.078962] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.079202] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: 7f79e24a-7fa9-442b-993d-45f98750417a is going to be created. [ 701.104581] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.104795] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.104919] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.105273] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.105504] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.105730] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-7f79e24a-7fa9-442b-993d-45f98750417a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.752944] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bb24e830-31ca-4b75-ba92-3835430fbf29 in Status: SUCCESS [ 701.753343] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bb24e830-31ca-4b75-ba92-3835430fbf29 deletion is rescheduled due to dependency. [ 701.753480] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bb24e830-31ca-4b75-ba92-3835430fbf29" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.838593] env[66502]: INFO networking_nsxv3.common.synchronization [req-150feec1-9624-4a3f-ab0e-062e6c11d860 req-ba245afa-be5c-4226-af40-312df9eea1eb service nova] Enqueued Resource ID: c7d21481-83aa-4bac-bea4-1030ed0a857b with Priority: HIGHEST for action security_group_rules [ 701.838774] env[66502]: INFO networking_nsxv3.common.synchronization [req-150feec1-9624-4a3f-ab0e-062e6c11d860 req-ba245afa-be5c-4226-af40-312df9eea1eb service nova] Enqueued Resource ID: c7d21481-83aa-4bac-bea4-1030ed0a857b with Priority: HIGHEST for action security_group_members [ 701.838902] env[66502]: INFO networking_nsxv3.common.synchronization [req-150feec1-9624-4a3f-ab0e-062e6c11d860 req-ba245afa-be5c-4226-af40-312df9eea1eb service nova] Enqueued Resource ID: 7f79e24a-7fa9-442b-993d-45f98750417a with Priority: HIGHEST for action port [ 701.839147] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7d21481-83aa-4bac-bea4-1030ed0a857b with Priority: HIGHEST for action security_group_rules [ 701.839301] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7d21481-83aa-4bac-bea4-1030ed0a857b with Priority: HIGHEST for action security_group_members [ 701.839393] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f79e24a-7fa9-442b-993d-45f98750417a with Priority: HIGHEST for action port [ 701.839950] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7d21481-83aa-4bac-bea4-1030ed0a857b taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.840128] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7d21481-83aa-4bac-bea4-1030ed0a857b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.840162] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7d21481-83aa-4bac-bea4-1030ed0a857b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.840343] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7d21481-83aa-4bac-bea4-1030ed0a857b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.840424] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7d21481-83aa-4bac-bea4-1030ed0a857b',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.841260] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7d21481-83aa-4bac-bea4-1030ed0a857b taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.841362] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7d21481-83aa-4bac-bea4-1030ed0a857b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.841456] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7d21481-83aa-4bac-bea4-1030ed0a857b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.841586] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7d21481-83aa-4bac-bea4-1030ed0a857b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.841757] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.841819] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.841884] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.842044] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.842136] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.842225] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7d21481-83aa-4bac-bea4-1030ed0a857b',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 701.842947] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f79e24a-7fa9-442b-993d-45f98750417a taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.843266] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f79e24a-7fa9-442b-993d-45f98750417a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.843351] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f79e24a-7fa9-442b-993d-45f98750417a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.843501] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f79e24a-7fa9-442b-993d-45f98750417a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.843585] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f79e24a-7fa9-442b-993d-45f98750417a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.345803] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7d21481-83aa-4bac-bea4-1030ed0a857b taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.345924] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7d21481-83aa-4bac-bea4-1030ed0a857b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.346367] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c7d21481-83aa-4bac-bea4-1030ed0a857b',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.347035] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7f79e24a-7fa9-442b-993d-45f98750417a with status ACTIVE [ 702.347221] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.347338] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.347406] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.347668] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.347702] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.347864] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.347959] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.348042] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.348202] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.348279] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.348489] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.348543] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.352340] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.352846] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.352846] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.352846] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7f79e24a-7fa9-442b-993d-45f98750417a is going to be updated. [ 702.375364] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.376666] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.376769] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.376981] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.377126] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.377292] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f79e24a-7fa9-442b-993d-45f98750417a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.616410] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49 in Status: SUCCESS [ 702.616410] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.616410] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.616410] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.616410] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 702.616410] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 702.616410] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 702.616410] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 702.616737] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.616737] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 702.616824] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 702.856361] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c7d21481-83aa-4bac-bea4-1030ed0a857b',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.119712] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.127262] env[66502]: INFO networking_nsxv3.common.synchronization [req-001c8592-e7fd-40d1-8232-38e80aca5c81 req-6645b142-47b3-4047-a9a1-079dad1536f5 tempest-ServerDiskConfigTestJSON-940033598 tempest-ServerDiskConfigTestJSON-940033598-project-member] Enqueued Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGHEST for action security_group_members [ 703.127772] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGHEST for action security_group_members [ 703.128069] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-aba51398-48dc-4f5e-b3cf-1da4130d58fb taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.128189] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.128251] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.128507] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.128656] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.128751] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.128810] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.129028] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.132061] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.132188] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.361554] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.361750] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.361852] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.362141] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.362241] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.362343] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7d21481-83aa-4bac-bea4-1030ed0a857b is going to be created. [ 703.391363] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.391499] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.391573] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.391792] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.391944] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.405219] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7d21481-83aa-4bac-bea4-1030ed0a857b in Status: UNINITIALIZED for 2s [ 703.521475] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-509 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.521660] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-509" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.521778] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-509" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.522122] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-509" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.522391] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.522540] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.522651] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.522864] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.523029] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.523237] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 703.523349] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 703.523451] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 703.523549] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 703.523648] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 703.523750] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 703.523871] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 703.542381] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 703.542584] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 703.542649] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 703.542815] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-509" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.543188] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-ece8c1a2-5027-4e64-a5a1-eb8b5ef9e60e taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.543363] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-ece8c1a2-5027-4e64-a5a1-eb8b5ef9e60e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.543472] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-ece8c1a2-5027-4e64-a5a1-eb8b5ef9e60e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.543786] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-ece8c1a2-5027-4e64-a5a1-eb8b5ef9e60e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.543917] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ece8c1a2-5027-4e64-a5a1-eb8b5ef9e60e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.622370] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49: rpc.has_security_group_logging(os_id): False [ 703.634453] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.634629] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.634683] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.634897] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.634990] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.635271] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.635373] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.635436] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.635584] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.635659] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.635741] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb already deleted. [ 703.635821] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.640177] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.640292] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.640359] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.640620] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.640704] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.640928] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.641040] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.641107] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.641250] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.641324] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.641410] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49 is going to be created. [ 703.718139] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.718287] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.718406] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.718576] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.718749] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.742024] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49 in Status: IN_PROGRESS for 2s [ 704.046844] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.047229] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.047229] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.048165] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.048165] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.048165] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port ece8c1a2-5027-4e64-a5a1-eb8b5ef9e60e not found, creating... [ 704.048388] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.048476] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.048607] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.048992] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.049096] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.049567] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.049703] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.049815] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.050028] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.050155] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.050286] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: ece8c1a2-5027-4e64-a5a1-eb8b5ef9e60e is going to be created. [ 704.074285] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.074285] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.074285] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.074582] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.074582] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.074755] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-ece8c1a2-5027-4e64-a5a1-eb8b5ef9e60e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.480859] env[66502]: INFO networking_nsxv3.common.synchronization [None req-c6a01e88-2424-4418-8d0d-ace3af161928 None None] Enqueued Resource ID: c6901131-015c-4de4-b0d4-ff7ae07cadb9 with Priority: HIGHEST for action port [ 704.480859] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6901131-015c-4de4-b0d4-ff7ae07cadb9 with Priority: HIGHEST for action port [ 704.480859] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-c6901131-015c-4de4-b0d4-ff7ae07cadb9 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.480859] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c6901131-015c-4de4-b0d4-ff7ae07cadb9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.480859] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c6901131-015c-4de4-b0d4-ff7ae07cadb9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.481294] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c6901131-015c-4de4-b0d4-ff7ae07cadb9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.481294] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c6901131-015c-4de4-b0d4-ff7ae07cadb9',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.864875] env[66502]: INFO networking_nsxv3.common.synchronization [req-001c8592-e7fd-40d1-8232-38e80aca5c81 req-6ff54295-650f-4eb4-b31d-16c4b1438551 service nova] Enqueued Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGHEST for action security_group_rules [ 704.864875] env[66502]: INFO networking_nsxv3.common.synchronization [req-001c8592-e7fd-40d1-8232-38e80aca5c81 req-6ff54295-650f-4eb4-b31d-16c4b1438551 service nova] Enqueued Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGHEST for action security_group_members [ 704.864875] env[66502]: INFO networking_nsxv3.common.synchronization [req-001c8592-e7fd-40d1-8232-38e80aca5c81 req-6ff54295-650f-4eb4-b31d-16c4b1438551 service nova] Enqueued Resource ID: ece8c1a2-5027-4e64-a5a1-eb8b5ef9e60e with Priority: HIGHEST for action port [ 704.864875] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGHEST for action security_group_rules [ 704.864875] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGHEST for action security_group_members [ 704.864875] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ece8c1a2-5027-4e64-a5a1-eb8b5ef9e60e with Priority: HIGHEST for action port [ 704.864875] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aba51398-48dc-4f5e-b3cf-1da4130d58fb taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.864875] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.864875] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.864875] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.864875] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.864875] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-aba51398-48dc-4f5e-b3cf-1da4130d58fb taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.864875] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.864875] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.864875] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.864875] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.865507] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.865507] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.871474] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.871474] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.871474] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.871474] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-ece8c1a2-5027-4e64-a5a1-eb8b5ef9e60e taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.871474] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ece8c1a2-5027-4e64-a5a1-eb8b5ef9e60e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.871474] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ece8c1a2-5027-4e64-a5a1-eb8b5ef9e60e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.871474] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ece8c1a2-5027-4e64-a5a1-eb8b5ef9e60e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.871474] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ece8c1a2-5027-4e64-a5a1-eb8b5ef9e60e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.985418] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c6901131-015c-4de4-b0d4-ff7ae07cadb9 [ 704.985647] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.985775] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.985846] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.986576] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.986576] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.986576] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c6901131-015c-4de4-b0d4-ff7ae07cadb9 already deleted. [ 704.986576] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c6901131-015c-4de4-b0d4-ff7ae07cadb9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.373041] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-aba51398-48dc-4f5e-b3cf-1da4130d58fb taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.373041] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.373041] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.373946] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ece8c1a2-5027-4e64-a5a1-eb8b5ef9e60e with status ACTIVE [ 705.373946] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.373946] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.373946] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.378120] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.378120] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.378120] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.378120] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.378120] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.378120] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.378120] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.378120] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.378120] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.378120] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.378120] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.378120] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.378120] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ece8c1a2-5027-4e64-a5a1-eb8b5ef9e60e is going to be updated. [ 705.403707] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.404786] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.404786] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.404786] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.404786] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.404786] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ece8c1a2-5027-4e64-a5a1-eb8b5ef9e60e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.417583] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7d21481-83aa-4bac-bea4-1030ed0a857b in Status: SUCCESS [ 705.419150] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7d21481-83aa-4bac-bea4-1030ed0a857b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.419150] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7d21481-83aa-4bac-bea4-1030ed0a857b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.419379] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7d21481-83aa-4bac-bea4-1030ed0a857b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.419468] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.419618] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.419715] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.419901] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.420080] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.420176] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7d21481-83aa-4bac-bea4-1030ed0a857b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.420276] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c7d21481-83aa-4bac-bea4-1030ed0a857b',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.616091] env[66502]: INFO networking_nsxv3.common.synchronization [req-d49bec1e-38ef-4615-9ca1-2eed6fe63ba9 req-a66b4a17-8ac1-4577-ab05-e3ae2a399614 tempest-ServerDiagnosticsNegativeTest-2130973331 tempest-ServerDiagnosticsNegativeTest-2130973331-project-member] Enqueued Resource ID: 9f4a2c28-0514-4b56-8107-7969d0d9335c with Priority: HIGHEST for action security_group_members [ 705.617017] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f4a2c28-0514-4b56-8107-7969d0d9335c with Priority: HIGHEST for action security_group_members [ 705.619307] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f4a2c28-0514-4b56-8107-7969d0d9335c taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.619307] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f4a2c28-0514-4b56-8107-7969d0d9335c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.619307] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f4a2c28-0514-4b56-8107-7969d0d9335c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.619307] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f4a2c28-0514-4b56-8107-7969d0d9335c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.619307] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.619307] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.619307] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.619307] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.619307] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.619307] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f4a2c28-0514-4b56-8107-7969d0d9335c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.755509] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49 in Status: SUCCESS [ 705.755509] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.879176] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.922949] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c7d21481-83aa-4bac-bea4-1030ed0a857b',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.121499] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.128253] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.128253] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.128253] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.128253] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.128253] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.128253] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.128253] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.128253] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.128253] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.128253] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f4a2c28-0514-4b56-8107-7969d0d9335c is going to be updated. [ 706.170171] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.170171] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.170171] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.170171] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.170171] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.179852] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f4a2c28-0514-4b56-8107-7969d0d9335c in Status: IN_PROGRESS for 2s [ 706.384983] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.385355] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.385355] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.387030] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.387030] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.387030] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb is going to be created. [ 706.426845] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c7d21481-83aa-4bac-bea4-1030ed0a857b: rpc.has_security_group_logging(os_id): False [ 706.429607] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.431019] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.431019] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.431019] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.431019] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.442905] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb in Status: UNINITIALIZED for 2s [ 706.458036] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.458036] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.458036] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.458455] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.458630] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.459725] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.460444] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.460558] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.460799] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.460912] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.461029] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7d21481-83aa-4bac-bea4-1030ed0a857b is going to be created. [ 706.537084] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.537547] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.537664] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.537951] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.538207] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.552216] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7d21481-83aa-4bac-bea4-1030ed0a857b in Status: IN_PROGRESS for 2s [ 707.066307] env[66502]: INFO networking_nsxv3.common.synchronization [None req-a989b38d-bb18-4fde-8888-5b3fccf1de3c None None] Enqueued Resource ID: a98e52ca-05c0-4fd8-857b-c47efe8203c9 with Priority: HIGHEST for action port [ 707.066307] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a98e52ca-05c0-4fd8-857b-c47efe8203c9 with Priority: HIGHEST for action port [ 707.067920] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-a98e52ca-05c0-4fd8-857b-c47efe8203c9 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.069791] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a98e52ca-05c0-4fd8-857b-c47efe8203c9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.069791] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a98e52ca-05c0-4fd8-857b-c47efe8203c9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.069791] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a98e52ca-05c0-4fd8-857b-c47efe8203c9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.069791] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a98e52ca-05c0-4fd8-857b-c47efe8203c9',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 707.572780] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a98e52ca-05c0-4fd8-857b-c47efe8203c9 [ 707.573115] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.573187] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.573258] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.573493] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.573578] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.573671] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a98e52ca-05c0-4fd8-857b-c47efe8203c9 already deleted. [ 707.573794] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a98e52ca-05c0-4fd8-857b-c47efe8203c9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.166573] env[66502]: INFO networking_nsxv3.common.synchronization [req-d662d2f0-469f-4eef-aff6-30b8536ef067 req-c3e563e3-bcc4-46f3-8e85-aff5078334e9 tempest-ImagesTestJSON-1088460097 tempest-ImagesTestJSON-1088460097-project-member] Enqueued Resource ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 with Priority: HIGHEST for action security_group_members [ 708.167483] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 with Priority: HIGHEST for action security_group_members [ 708.167483] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.167704] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.167704] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.167850] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.168012] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.168146] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.168333] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.168333] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.168476] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.168519] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.201446] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f4a2c28-0514-4b56-8107-7969d0d9335c in Status: SUCCESS [ 708.201624] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f4a2c28-0514-4b56-8107-7969d0d9335c deletion is rescheduled due to dependency. [ 708.201738] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f4a2c28-0514-4b56-8107-7969d0d9335c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.358072] env[66502]: INFO networking_nsxv3.common.synchronization [req-3471b26c-f92b-46b3-aefd-95dfa95e1df8 req-e2e654b1-b116-49d3-bd55-d9bf4732b1dc tempest-VolumesAdminNegativeTest-898295607 tempest-VolumesAdminNegativeTest-898295607-project-member] Enqueued Resource ID: 32ff0aad-cfa5-4379-8483-9c7077a46f10 with Priority: HIGHEST for action security_group_members [ 708.358644] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32ff0aad-cfa5-4379-8483-9c7077a46f10 with Priority: HIGHEST for action security_group_members [ 708.366747] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-32ff0aad-cfa5-4379-8483-9c7077a46f10 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.366747] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-32ff0aad-cfa5-4379-8483-9c7077a46f10" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.366747] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-32ff0aad-cfa5-4379-8483-9c7077a46f10" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.366747] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-32ff0aad-cfa5-4379-8483-9c7077a46f10" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.366747] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.366747] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.366747] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.366747] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.366747] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.366747] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('32ff0aad-cfa5-4379-8483-9c7077a46f10',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.454586] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb in Status: SUCCESS [ 708.454856] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.455066] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.455367] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.455798] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.455876] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.455910] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.456091] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.456209] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.456285] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.457262] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.571358] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7d21481-83aa-4bac-bea4-1030ed0a857b in Status: SUCCESS [ 708.571606] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7d21481-83aa-4bac-bea4-1030ed0a857b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.670372] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.670796] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.670796] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.670876] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.670974] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.671196] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.671291] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.671358] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.671516] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.671651] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.671742] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 is going to be updated. [ 708.719969] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.720217] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.720261] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.720610] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.720830] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.735397] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-545 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.737021] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-545" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.737021] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-545" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.737021] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-545" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.737021] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.737021] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.737486] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.737527] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.737753] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.738063] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 708.738231] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 708.738402] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 708.738557] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 708.738712] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 708.738875] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 708.739084] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 708.747970] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 in Status: IN_PROGRESS for 2s [ 708.782233] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 708.782538] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.043 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 708.782686] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 708.782894] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-545" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.783365] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-715a9f2d-d030-4a73-ab18-3bcfd63a611c taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.783577] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-715a9f2d-d030-4a73-ab18-3bcfd63a611c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.784048] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-715a9f2d-d030-4a73-ab18-3bcfd63a611c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.785292] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-715a9f2d-d030-4a73-ab18-3bcfd63a611c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.785521] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('715a9f2d-d030-4a73-ab18-3bcfd63a611c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.866602] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.866797] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.866873] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.867151] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.867224] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.867405] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.867508] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.867577] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.867767] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.867847] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.867953] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32ff0aad-cfa5-4379-8483-9c7077a46f10 is going to be updated. [ 708.906462] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.906462] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.906462] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.906462] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.906462] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.916785] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32ff0aad-cfa5-4379-8483-9c7077a46f10 in Status: IN_PROGRESS for 2s [ 708.963048] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-aba51398-48dc-4f5e-b3cf-1da4130d58fb taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.963048] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.963048] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.963048] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.963048] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.963048] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.963048] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.963048] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.963048] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.963048] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.963048] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-aba51398-48dc-4f5e-b3cf-1da4130d58fb taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.963048] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.963048] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.963048] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.963048] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.963048] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.963767] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.963767] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.963767] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.963767] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.963767] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.294037] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.294037] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.294037] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.294037] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.294037] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.294037] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 715a9f2d-d030-4a73-ab18-3bcfd63a611c not found, creating... [ 709.294749] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.295143] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.295443] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.295816] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.296066] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.296452] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.296747] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.296954] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.297269] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.297491] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.299203] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 715a9f2d-d030-4a73-ab18-3bcfd63a611c is going to be created. [ 709.320905] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.320905] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.320905] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.320905] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.320905] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.320905] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-715a9f2d-d030-4a73-ab18-3bcfd63a611c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.466919] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aba51398-48dc-4f5e-b3cf-1da4130d58fb: rpc.has_security_group_logging(os_id): False [ 709.489996] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.490266] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.490266] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.490428] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.490523] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.490738] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.490842] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.490894] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.491042] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.491126] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.491292] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.491373] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.491436] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.491575] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.491644] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.491818] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.491922] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.491975] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.492107] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.492174] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.492257] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb is going to be created. [ 709.594836] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.595328] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.595328] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.595328] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.595484] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.612691] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb in Status: IN_PROGRESS for 2s [ 710.078669] env[66502]: INFO networking_nsxv3.common.synchronization [req-d662d2f0-469f-4eef-aff6-30b8536ef067 req-b895afe7-76dc-41a6-92a7-3cb568258ea2 service nova] Enqueued Resource ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 with Priority: HIGHEST for action security_group_rules [ 710.078669] env[66502]: INFO networking_nsxv3.common.synchronization [req-d662d2f0-469f-4eef-aff6-30b8536ef067 req-b895afe7-76dc-41a6-92a7-3cb568258ea2 service nova] Enqueued Resource ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 with Priority: HIGHEST for action security_group_members [ 710.079054] env[66502]: INFO networking_nsxv3.common.synchronization [req-d662d2f0-469f-4eef-aff6-30b8536ef067 req-b895afe7-76dc-41a6-92a7-3cb568258ea2 service nova] Enqueued Resource ID: 715a9f2d-d030-4a73-ab18-3bcfd63a611c with Priority: HIGHEST for action port [ 710.079438] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 with Priority: HIGHEST for action security_group_rules [ 710.079694] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 with Priority: HIGHEST for action security_group_members [ 710.079694] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 715a9f2d-d030-4a73-ab18-3bcfd63a611c with Priority: HIGHEST for action port [ 710.079948] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.081398] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.081398] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.081398] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.081547] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.082419] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.082532] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.082720] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-715a9f2d-d030-4a73-ab18-3bcfd63a611c taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.082843] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-715a9f2d-d030-4a73-ab18-3bcfd63a611c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.082923] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-715a9f2d-d030-4a73-ab18-3bcfd63a611c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.083083] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-715a9f2d-d030-4a73-ab18-3bcfd63a611c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.083154] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('715a9f2d-d030-4a73-ab18-3bcfd63a611c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.567283] env[66502]: INFO networking_nsxv3.common.synchronization [req-e00da539-a432-4a41-8cb5-59186b4ca971 req-a772a447-5f73-44c3-9497-236a771d826e tempest-FloatingIPsAssociationTestJSON-843355077 tempest-FloatingIPsAssociationTestJSON-843355077-project-member] Enqueued Resource ID: e12852c1-7dc2-4ed2-bd34-e396f9f9256d with Priority: HIGHEST for action security_group_members [ 710.568177] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e12852c1-7dc2-4ed2-bd34-e396f9f9256d with Priority: HIGHEST for action security_group_members [ 710.568517] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.568601] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.568666] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.569086] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.569086] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.569182] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.569212] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.569341] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.569426] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.569546] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e12852c1-7dc2-4ed2-bd34-e396f9f9256d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.587543] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.587543] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.587543] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 715a9f2d-d030-4a73-ab18-3bcfd63a611c with status ACTIVE [ 710.587543] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.587824] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.587824] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.587900] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.588251] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.588251] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.588470] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.588470] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.588532] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.588609] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.588905] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.588905] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.589031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.589395] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.589505] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.589614] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 715a9f2d-d030-4a73-ab18-3bcfd63a611c is going to be updated. [ 710.620385] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.620385] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.620385] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.621096] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.621287] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.621513] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-715a9f2d-d030-4a73-ab18-3bcfd63a611c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.766022] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 in Status: SUCCESS [ 710.766022] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 deletion is rescheduled due to dependency. [ 710.766022] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.766022] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.766022] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.766022] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.766022] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.766022] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.766022] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.766022] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.766022] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.928549] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 32ff0aad-cfa5-4379-8483-9c7077a46f10 in Status: SUCCESS [ 710.928802] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 32ff0aad-cfa5-4379-8483-9c7077a46f10 deletion is rescheduled due to dependency. [ 710.928971] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-32ff0aad-cfa5-4379-8483-9c7077a46f10" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.073105] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e12852c1-7dc2-4ed2-bd34-e396f9f9256d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.270418] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.575092] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e12852c1-7dc2-4ed2-bd34-e396f9f9256d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.629142] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb in Status: SUCCESS [ 711.629694] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.773565] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.079274] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.079274] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.079274] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.079274] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.079274] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.079274] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e12852c1-7dc2-4ed2-bd34-e396f9f9256d is going to be updated. [ 712.111087] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.111267] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.111343] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.111548] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.111686] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.122908] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e12852c1-7dc2-4ed2-bd34-e396f9f9256d in Status: IN_PROGRESS for 2s [ 712.280223] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.280582] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.280582] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.280830] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.280935] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.281069] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 is going to be updated. [ 712.325049] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.326018] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.326018] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.326018] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.326018] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.336750] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 in Status: IN_PROGRESS for 2s [ 714.137880] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e12852c1-7dc2-4ed2-bd34-e396f9f9256d in Status: SUCCESS [ 714.137880] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.354466] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 in Status: SUCCESS [ 714.354466] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.354466] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.354466] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.354466] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.354466] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.354466] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.354466] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.354466] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.354466] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.354466] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.857627] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.857785] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.857898] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.858098] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.858272] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.858376] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.858436] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.858671] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.858671] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.858811] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.858885] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.858979] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.859081] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.859181] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.859320] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.859409] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.859469] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.859611] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.859674] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.859752] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.859838] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.365487] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2: rpc.has_security_group_logging(os_id): False [ 715.386669] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.386669] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.386669] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.386669] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.386669] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.386669] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.386669] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.386669] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.386669] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.386669] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.386669] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.387576] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.387576] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.387576] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.387576] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.391086] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.391211] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.391276] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.391425] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.391504] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.391590] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 is going to be updated. [ 715.452037] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.452037] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.452306] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.452306] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.452462] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.467546] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 in Status: IN_PROGRESS for 2s [ 715.569782] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 715.569782] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 715.826516] env[66502]: INFO networking_nsxv3.common.synchronization [req-aabee46e-ccbc-4191-a1ae-2cbb9a792e97 req-0b149c34-3847-4919-85ef-e06a968b30df tempest-ServersAdminTestJSON-292997046 tempest-ServersAdminTestJSON-292997046-project-member] Enqueued Resource ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 with Priority: HIGHEST for action security_group_members [ 715.827229] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 with Priority: HIGHEST for action security_group_members [ 715.828044] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.828044] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.828044] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.828044] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.831035] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.831035] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.831035] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.831035] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.831035] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.831035] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.333701] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.333889] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.333929] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.334202] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.334309] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.334521] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.334622] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.334684] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.334845] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.335143] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.335143] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 already deleted. [ 716.335143] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.341675] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-8 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.341969] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.341969] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.342265] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.342535] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.342685] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.342900] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.342987] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.343157] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.343383] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 716.343504] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 716.343609] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 716.343797] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 716.343797] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 716.343932] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 716.344021] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 716.363520] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 716.363711] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 716.363828] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 716.364016] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.364335] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-5fb7228a-4d10-4cb7-91c3-d67037313908 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.364505] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-5fb7228a-4d10-4cb7-91c3-d67037313908" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.364605] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-5fb7228a-4d10-4cb7-91c3-d67037313908" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.364915] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-5fb7228a-4d10-4cb7-91c3-d67037313908" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.365056] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fb7228a-4d10-4cb7-91c3-d67037313908',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.603785] env[66502]: INFO networking_nsxv3.common.synchronization [req-66f8f6e6-c7b8-417a-ba3f-6e17041df5ed req-79f19200-7c1b-46d8-a061-cc750b2c7c34 tempest-ServersWithSpecificFlavorTestJSON-713469048 tempest-ServersWithSpecificFlavorTestJSON-713469048-project-member] Enqueued Resource ID: 7421254e-fac2-4232-97e1-1f7373688543 with Priority: HIGHEST for action security_group_members [ 716.604815] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7421254e-fac2-4232-97e1-1f7373688543 with Priority: HIGHEST for action security_group_members [ 716.604815] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-7421254e-fac2-4232-97e1-1f7373688543 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.605015] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.605015] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.605537] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.605772] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.605880] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.605941] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.606108] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.606217] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.606348] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7421254e-fac2-4232-97e1-1f7373688543',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 716.867494] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.867736] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.867857] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.868156] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.868324] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.868659] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 5fb7228a-4d10-4cb7-91c3-d67037313908 not found, creating... [ 716.868799] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.869337] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.869337] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.869637] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.869985] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.870096] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.870787] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.870787] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.870787] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.870787] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.870989] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 5fb7228a-4d10-4cb7-91c3-d67037313908 is going to be created. [ 716.894567] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.895069] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.895219] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.895864] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.895976] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.896246] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-5fb7228a-4d10-4cb7-91c3-d67037313908" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.108235] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.108444] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.108520] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.108748] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.108847] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.109063] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.109167] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.109253] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.109406] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.109484] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.109572] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7421254e-fac2-4232-97e1-1f7373688543 is going to be updated. [ 717.152393] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.152554] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.152602] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.152888] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.153046] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.163330] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7421254e-fac2-4232-97e1-1f7373688543 in Status: IN_PROGRESS for 2s [ 717.480576] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 in Status: SUCCESS [ 717.480816] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.586286] env[66502]: INFO networking_nsxv3.common.synchronization [req-aabee46e-ccbc-4191-a1ae-2cbb9a792e97 req-6225e018-2333-4c67-898b-0a8fce8cf99e service nova] Enqueued Resource ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 with Priority: HIGHEST for action security_group_rules [ 717.586286] env[66502]: INFO networking_nsxv3.common.synchronization [req-aabee46e-ccbc-4191-a1ae-2cbb9a792e97 req-6225e018-2333-4c67-898b-0a8fce8cf99e service nova] Enqueued Resource ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 with Priority: HIGHEST for action security_group_members [ 717.586450] env[66502]: INFO networking_nsxv3.common.synchronization [req-aabee46e-ccbc-4191-a1ae-2cbb9a792e97 req-6225e018-2333-4c67-898b-0a8fce8cf99e service nova] Enqueued Resource ID: 5fb7228a-4d10-4cb7-91c3-d67037313908 with Priority: HIGHEST for action port [ 717.586608] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 with Priority: HIGHEST for action security_group_rules [ 717.586729] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 with Priority: HIGHEST for action security_group_members [ 717.586818] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fb7228a-4d10-4cb7-91c3-d67037313908 with Priority: HIGHEST for action port [ 717.587377] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee2e9577-19ff-440d-9bd8-24dbaf88ea24 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.587531] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.588183] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.588183] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.588183] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.589106] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.591604] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.591604] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.591604] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.591604] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.591604] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.591604] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.591604] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.591604] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.591604] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.591604] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-5fb7228a-4d10-4cb7-91c3-d67037313908 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.591604] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5fb7228a-4d10-4cb7-91c3-d67037313908" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.591604] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5fb7228a-4d10-4cb7-91c3-d67037313908" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.592155] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5fb7228a-4d10-4cb7-91c3-d67037313908" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.592155] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fb7228a-4d10-4cb7-91c3-d67037313908',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.097769] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.098059] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.098162] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 718.102372] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5fb7228a-4d10-4cb7-91c3-d67037313908 with status ACTIVE [ 718.102372] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.102372] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.102372] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.102372] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.102372] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.102372] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.102372] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.102372] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.102372] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.102372] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.102372] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.102372] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.102372] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.102372] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.102372] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.102372] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5fb7228a-4d10-4cb7-91c3-d67037313908 is going to be updated. [ 718.128335] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.128476] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.128934] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.128934] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.128934] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.129127] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5fb7228a-4d10-4cb7-91c3-d67037313908" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.604119] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.107180] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.107525] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.108577] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.108577] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.108577] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.108577] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 is going to be created. [ 719.135713] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.135931] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.136012] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.136236] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.136402] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.148373] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 in Status: UNINITIALIZED for 2s [ 719.175020] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7421254e-fac2-4232-97e1-1f7373688543 in Status: SUCCESS [ 719.175020] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7421254e-fac2-4232-97e1-1f7373688543 deletion is rescheduled due to dependency. [ 719.175020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.166202] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 in Status: SUCCESS [ 721.166605] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.169103] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.169103] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.169103] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.169103] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.169103] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.169103] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.169103] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.169103] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.169103] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.674800] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.675629] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.675629] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.675629] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.675629] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.675629] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.675629] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.675865] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.675897] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.675993] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.676131] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.676281] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.676326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.676895] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.676895] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.676895] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.676895] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.676895] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.677087] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.677087] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.677147] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.122146] env[66502]: INFO networking_nsxv3.common.synchronization [None req-aed9fa2b-b4a9-43f2-86d4-122199c5bec1 None None] Enqueued Resource ID: 0da81602-2c17-4b3a-a806-2e32718f2c22 with Priority: HIGHEST for action port [ 722.123277] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0da81602-2c17-4b3a-a806-2e32718f2c22 with Priority: HIGHEST for action port [ 722.123277] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-0da81602-2c17-4b3a-a806-2e32718f2c22 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.123277] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0da81602-2c17-4b3a-a806-2e32718f2c22" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.123277] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0da81602-2c17-4b3a-a806-2e32718f2c22" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.123540] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0da81602-2c17-4b3a-a806-2e32718f2c22" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.123604] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0da81602-2c17-4b3a-a806-2e32718f2c22',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.180982] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ee2e9577-19ff-440d-9bd8-24dbaf88ea24: rpc.has_security_group_logging(os_id): False [ 722.201977] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.202140] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.202213] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.202437] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.202530] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.202721] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.202817] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.202880] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.204054] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.204186] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.204568] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.204679] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.204745] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.204897] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.205031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.205731] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.205839] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.205907] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.206101] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.206171] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.206230] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 is going to be created. [ 722.269184] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.269330] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.269384] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.269614] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.269795] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.284973] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 in Status: IN_PROGRESS for 2s [ 722.634948] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0da81602-2c17-4b3a-a806-2e32718f2c22 [ 722.635273] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.635441] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.635495] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.635689] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.635774] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.635869] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0da81602-2c17-4b3a-a806-2e32718f2c22 already deleted. [ 722.635951] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0da81602-2c17-4b3a-a806-2e32718f2c22" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.889504] env[66502]: INFO networking_nsxv3.common.synchronization [None req-9ad1f2ea-2920-487e-bb60-ed82fd600005 tempest-ImagesOneServerNegativeTestJSON-1621881971 tempest-ImagesOneServerNegativeTestJSON-1621881971-project-member] Enqueued Resource ID: 51368c63-6595-4ce8-b62f-b13a695d9a09 with Priority: HIGHEST for action security_group_rules [ 722.891738] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51368c63-6595-4ce8-b62f-b13a695d9a09 with Priority: HIGHEST for action security_group_rules [ 722.892364] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-51368c63-6595-4ce8-b62f-b13a695d9a09 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.892364] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-51368c63-6595-4ce8-b62f-b13a695d9a09" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.892364] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-51368c63-6595-4ce8-b62f-b13a695d9a09" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.892790] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-51368c63-6595-4ce8-b62f-b13a695d9a09" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.892790] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('51368c63-6595-4ce8-b62f-b13a695d9a09',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.010676] env[66502]: INFO networking_nsxv3.common.synchronization [None req-9b2bc0e5-42b0-450c-9ff9-b5207838efcd tempest-ImagesOneServerNegativeTestJSON-1621881971 tempest-ImagesOneServerNegativeTestJSON-1621881971-project-member] Enqueued Resource ID: 51368c63-6595-4ce8-b62f-b13a695d9a09 with Priority: HIGHEST for action security_group_rules [ 723.011080] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51368c63-6595-4ce8-b62f-b13a695d9a09 with Priority: HIGHEST for action security_group_rules [ 723.011380] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-51368c63-6595-4ce8-b62f-b13a695d9a09 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.011475] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-51368c63-6595-4ce8-b62f-b13a695d9a09" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.419109] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.419520] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.419520] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.419631] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.419777] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.419885] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 51368c63-6595-4ce8-b62f-b13a695d9a09 already deleted. [ 723.419967] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-51368c63-6595-4ce8-b62f-b13a695d9a09" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.420135] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-51368c63-6595-4ce8-b62f-b13a695d9a09" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.420311] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-51368c63-6595-4ce8-b62f-b13a695d9a09" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.420429] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('51368c63-6595-4ce8-b62f-b13a695d9a09',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.945030] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.945030] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.945030] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.945030] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.945030] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.945030] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 51368c63-6595-4ce8-b62f-b13a695d9a09 already deleted. [ 723.945030] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-51368c63-6595-4ce8-b62f-b13a695d9a09" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.299132] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 in Status: SUCCESS [ 724.299368] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.504086] env[66502]: INFO networking_nsxv3.common.synchronization [None req-c5c03fac-3116-46b5-8ea5-763e0bbac32e None None] Enqueued Resource ID: c934acd9-3ec2-45a9-b227-b9202d20596a with Priority: HIGHEST for action port [ 724.504495] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c934acd9-3ec2-45a9-b227-b9202d20596a with Priority: HIGHEST for action port [ 724.504897] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-c934acd9-3ec2-45a9-b227-b9202d20596a taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.504897] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c934acd9-3ec2-45a9-b227-b9202d20596a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.505074] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c934acd9-3ec2-45a9-b227-b9202d20596a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.505775] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c934acd9-3ec2-45a9-b227-b9202d20596a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.506019] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c934acd9-3ec2-45a9-b227-b9202d20596a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.009034] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c934acd9-3ec2-45a9-b227-b9202d20596a [ 725.009365] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.011777] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.011777] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.011777] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.011777] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.011777] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c934acd9-3ec2-45a9-b227-b9202d20596a already deleted. [ 725.011777] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c934acd9-3ec2-45a9-b227-b9202d20596a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.108388] env[66502]: INFO networking_nsxv3.common.synchronization [None req-d3f2348e-a9b5-4909-b149-3195a3ca3119 None None] Enqueued Resource ID: 1900fd03-9e80-4ad0-a21d-c98df42c9a25 with Priority: HIGHEST for action port [ 725.109543] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1900fd03-9e80-4ad0-a21d-c98df42c9a25 with Priority: HIGHEST for action port [ 725.109908] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-1900fd03-9e80-4ad0-a21d-c98df42c9a25 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.110043] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1900fd03-9e80-4ad0-a21d-c98df42c9a25" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.110108] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1900fd03-9e80-4ad0-a21d-c98df42c9a25" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.110360] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1900fd03-9e80-4ad0-a21d-c98df42c9a25" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.110442] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1900fd03-9e80-4ad0-a21d-c98df42c9a25',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.613587] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 1900fd03-9e80-4ad0-a21d-c98df42c9a25 [ 725.613915] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.614011] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.614107] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.614367] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.614478] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.614605] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:1900fd03-9e80-4ad0-a21d-c98df42c9a25 already deleted. [ 725.614706] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1900fd03-9e80-4ad0-a21d-c98df42c9a25" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.522784] env[66502]: INFO networking_nsxv3.common.synchronization [None req-f852411c-767a-4e11-b91a-c4e22aeff47d None None] Enqueued Resource ID: 53e896a6-7dfe-4bf0-b7cd-58e091f1c6ba with Priority: HIGHEST for action port [ 727.525294] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 53e896a6-7dfe-4bf0-b7cd-58e091f1c6ba with Priority: HIGHEST for action port [ 727.525294] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-53e896a6-7dfe-4bf0-b7cd-58e091f1c6ba taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.525294] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-53e896a6-7dfe-4bf0-b7cd-58e091f1c6ba" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.525294] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-53e896a6-7dfe-4bf0-b7cd-58e091f1c6ba" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.525294] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-53e896a6-7dfe-4bf0-b7cd-58e091f1c6ba" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.525294] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('53e896a6-7dfe-4bf0-b7cd-58e091f1c6ba',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.027632] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 53e896a6-7dfe-4bf0-b7cd-58e091f1c6ba [ 728.027632] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.027632] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.027632] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.028029] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.028029] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.028094] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:53e896a6-7dfe-4bf0-b7cd-58e091f1c6ba already deleted. [ 728.028139] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-53e896a6-7dfe-4bf0-b7cd-58e091f1c6ba" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.333315] env[66502]: INFO networking_nsxv3.common.synchronization [req-37a7671d-05fd-4fd5-b33a-26dcbc9f73a4 req-13f88b75-d5cc-413e-95d9-e6ebb3c4da0e tempest-ServerDiskConfigTestJSON-940033598 tempest-ServerDiskConfigTestJSON-940033598-project-member] Enqueued Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGHEST for action security_group_members [ 730.334434] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGHEST for action security_group_members [ 730.334434] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-aba51398-48dc-4f5e-b3cf-1da4130d58fb taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.334603] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.334603] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.334862] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.335060] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.335189] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.335318] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.335494] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.335586] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.335680] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.838578] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.838738] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.838813] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.839053] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.839155] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.839358] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.839457] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.839519] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.839667] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.839745] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.840049] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb is going to be updated. [ 730.874943] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.875093] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.875161] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.875506] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.875648] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.887222] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb in Status: IN_PROGRESS for 2s [ 731.795751] env[66502]: INFO networking_nsxv3.common.synchronization [req-87bbb133-8a97-400a-91c3-9b08f9fd0ed8 req-d2368ebf-adc9-49df-8170-c1b93b055ce6 tempest-ServersAdminNegativeTestJSON-39144073 tempest-ServersAdminNegativeTestJSON-39144073-project-member] Enqueued Resource ID: 881e7189-5d27-4efb-b9a3-71f2b26c3add with Priority: HIGHEST for action security_group_members [ 731.798396] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 881e7189-5d27-4efb-b9a3-71f2b26c3add with Priority: HIGHEST for action security_group_members [ 731.798396] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-881e7189-5d27-4efb-b9a3-71f2b26c3add taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.798396] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.798396] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.798396] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.798396] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.798396] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.798396] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.798877] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.798877] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.798877] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('881e7189-5d27-4efb-b9a3-71f2b26c3add',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.179022] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-670 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.179022] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.179022] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.179022] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.179022] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.179022] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.179486] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.181377] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.181874] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.182214] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 732.182568] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 732.182895] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 732.186609] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 732.186609] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 732.186609] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 732.186609] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 732.207029] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 732.207029] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 732.207029] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 732.207029] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.207029] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-db6e992c-0ac4-4dd7-884e-8588a02b6e5c taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.207029] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-db6e992c-0ac4-4dd7-884e-8588a02b6e5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.207029] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-db6e992c-0ac4-4dd7-884e-8588a02b6e5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.207029] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-db6e992c-0ac4-4dd7-884e-8588a02b6e5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.207029] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db6e992c-0ac4-4dd7-884e-8588a02b6e5c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.301510] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('881e7189-5d27-4efb-b9a3-71f2b26c3add',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.392849] env[66502]: INFO networking_nsxv3.common.synchronization [None req-63291c7e-75fd-4559-bf0c-cf22324f1a7e None None] Enqueued Resource ID: 96cf83e3-bb63-44d5-997d-574666b691eb with Priority: HIGHEST for action port [ 732.393531] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96cf83e3-bb63-44d5-997d-574666b691eb with Priority: HIGHEST for action port [ 732.394411] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-96cf83e3-bb63-44d5-997d-574666b691eb taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.394644] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96cf83e3-bb63-44d5-997d-574666b691eb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.394754] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96cf83e3-bb63-44d5-997d-574666b691eb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.395053] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96cf83e3-bb63-44d5-997d-574666b691eb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.395160] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96cf83e3-bb63-44d5-997d-574666b691eb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.711662] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.711914] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.712064] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.712414] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.712569] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.712732] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port db6e992c-0ac4-4dd7-884e-8588a02b6e5c not found, creating... [ 732.713121] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.713367] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.713491] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.713764] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.713949] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.714522] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.714734] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.714855] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.715075] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.715207] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.715449] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: db6e992c-0ac4-4dd7-884e-8588a02b6e5c is going to be created. [ 732.736813] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.737022] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.737314] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.737619] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.737865] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.738498] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-db6e992c-0ac4-4dd7-884e-8588a02b6e5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.803788] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('881e7189-5d27-4efb-b9a3-71f2b26c3add',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.898588] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 96cf83e3-bb63-44d5-997d-574666b691eb [ 732.898588] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.898588] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.898588] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.898588] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.898588] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.898588] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:96cf83e3-bb63-44d5-997d-574666b691eb already deleted. [ 732.898588] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96cf83e3-bb63-44d5-997d-574666b691eb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.902755] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb in Status: SUCCESS [ 732.902755] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb deletion is rescheduled due to dependency. [ 732.902755] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.309901] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.309901] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.309901] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.309901] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.309901] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.309901] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 881e7189-5d27-4efb-b9a3-71f2b26c3add is going to be updated. [ 733.340136] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.340794] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.340794] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.340794] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.340794] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.352018] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 881e7189-5d27-4efb-b9a3-71f2b26c3add in Status: IN_PROGRESS for 2s [ 733.471952] env[66502]: INFO networking_nsxv3.common.synchronization [req-87bbb133-8a97-400a-91c3-9b08f9fd0ed8 req-e1a34687-be06-4494-85d4-fa5e05400289 service nova] Enqueued Resource ID: 881e7189-5d27-4efb-b9a3-71f2b26c3add with Priority: HIGHEST for action security_group_rules [ 733.471952] env[66502]: INFO networking_nsxv3.common.synchronization [req-87bbb133-8a97-400a-91c3-9b08f9fd0ed8 req-e1a34687-be06-4494-85d4-fa5e05400289 service nova] Enqueued Resource ID: 881e7189-5d27-4efb-b9a3-71f2b26c3add with Priority: HIGHEST for action security_group_members [ 733.471952] env[66502]: INFO networking_nsxv3.common.synchronization [req-87bbb133-8a97-400a-91c3-9b08f9fd0ed8 req-e1a34687-be06-4494-85d4-fa5e05400289 service nova] Enqueued Resource ID: db6e992c-0ac4-4dd7-884e-8588a02b6e5c with Priority: HIGHEST for action port [ 733.472164] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 881e7189-5d27-4efb-b9a3-71f2b26c3add with Priority: HIGHEST for action security_group_rules [ 733.472164] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 881e7189-5d27-4efb-b9a3-71f2b26c3add with Priority: HIGHEST for action security_group_members [ 733.472319] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db6e992c-0ac4-4dd7-884e-8588a02b6e5c with Priority: HIGHEST for action port [ 733.472469] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-881e7189-5d27-4efb-b9a3-71f2b26c3add taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.472600] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.472668] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.472913] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.472913] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('881e7189-5d27-4efb-b9a3-71f2b26c3add',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.473940] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-881e7189-5d27-4efb-b9a3-71f2b26c3add taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.474104] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.474357] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-db6e992c-0ac4-4dd7-884e-8588a02b6e5c taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.474485] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db6e992c-0ac4-4dd7-884e-8588a02b6e5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.474553] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db6e992c-0ac4-4dd7-884e-8588a02b6e5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.474760] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db6e992c-0ac4-4dd7-884e-8588a02b6e5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.474841] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db6e992c-0ac4-4dd7-884e-8588a02b6e5c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.978959] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-881e7189-5d27-4efb-b9a3-71f2b26c3add taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.978959] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.981035] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port db6e992c-0ac4-4dd7-884e-8588a02b6e5c with status ACTIVE [ 733.983886] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.983886] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.983886] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.983886] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.983886] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.983886] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.983886] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.983886] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.983886] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.983886] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.983886] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.983886] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.983886] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.983886] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.983886] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.983886] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: db6e992c-0ac4-4dd7-884e-8588a02b6e5c is going to be updated. [ 734.009176] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.009176] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.009176] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.009417] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.009679] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.009679] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db6e992c-0ac4-4dd7-884e-8588a02b6e5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.517792] env[66502]: INFO networking_nsxv3.common.synchronization [None req-e674bb18-c80b-4382-9a0b-aff44444fee8 None None] Enqueued Resource ID: 02a0233b-7d2b-49b5-b620-97d8b387420a with Priority: HIGHEST for action port [ 734.518413] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 02a0233b-7d2b-49b5-b620-97d8b387420a with Priority: HIGHEST for action port [ 734.518785] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-02a0233b-7d2b-49b5-b620-97d8b387420a taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.518913] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-02a0233b-7d2b-49b5-b620-97d8b387420a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.519026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-02a0233b-7d2b-49b5-b620-97d8b387420a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.521643] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-02a0233b-7d2b-49b5-b620-97d8b387420a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.521643] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('02a0233b-7d2b-49b5-b620-97d8b387420a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.023025] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 02a0233b-7d2b-49b5-b620-97d8b387420a [ 735.023296] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.023567] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.023567] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.023703] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.023780] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.023883] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:02a0233b-7d2b-49b5-b620-97d8b387420a already deleted. [ 735.024020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-02a0233b-7d2b-49b5-b620-97d8b387420a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.363166] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 881e7189-5d27-4efb-b9a3-71f2b26c3add in Status: SUCCESS [ 735.363407] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.363604] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.363860] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.364067] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.364188] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.364290] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.364412] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.364492] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.364618] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('881e7189-5d27-4efb-b9a3-71f2b26c3add',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.868145] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('881e7189-5d27-4efb-b9a3-71f2b26c3add',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.373149] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('881e7189-5d27-4efb-b9a3-71f2b26c3add',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.876168] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.876348] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.876405] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.876631] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.876732] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.876831] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 881e7189-5d27-4efb-b9a3-71f2b26c3add is going to be updated. [ 736.910972] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.911151] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.911323] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.911442] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.911627] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.921109] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 881e7189-5d27-4efb-b9a3-71f2b26c3add in Status: IN_PROGRESS for 2s [ 737.055429] env[66502]: INFO networking_nsxv3.common.synchronization [None req-61b8559c-f4e7-494c-93f1-56a65fb2d29a tempest-MigrationsAdminTest-636676794 tempest-MigrationsAdminTest-636676794-project-member] Enqueued Resource ID: 0d4b3a48-4963-4afa-b867-26090ac5a1c5 with Priority: HIGHEST for action security_group_rules [ 737.056039] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d4b3a48-4963-4afa-b867-26090ac5a1c5 with Priority: HIGHEST for action security_group_rules [ 737.056332] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d4b3a48-4963-4afa-b867-26090ac5a1c5 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.056985] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d4b3a48-4963-4afa-b867-26090ac5a1c5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.056985] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d4b3a48-4963-4afa-b867-26090ac5a1c5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.056985] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d4b3a48-4963-4afa-b867-26090ac5a1c5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.056985] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d4b3a48-4963-4afa-b867-26090ac5a1c5',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.283695] env[66502]: INFO networking_nsxv3.common.synchronization [None req-553b3c97-cadf-4be0-b6cf-eae82d1ed2ff tempest-MigrationsAdminTest-636676794 tempest-MigrationsAdminTest-636676794-project-member] Enqueued Resource ID: 0d4b3a48-4963-4afa-b867-26090ac5a1c5 with Priority: HIGHEST for action security_group_rules [ 737.283695] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d4b3a48-4963-4afa-b867-26090ac5a1c5 with Priority: HIGHEST for action security_group_rules [ 737.283695] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d4b3a48-4963-4afa-b867-26090ac5a1c5 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.283695] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d4b3a48-4963-4afa-b867-26090ac5a1c5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.579526] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.579891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.579891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.579998] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.580140] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.580239] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d4b3a48-4963-4afa-b867-26090ac5a1c5 already deleted. [ 737.580333] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d4b3a48-4963-4afa-b867-26090ac5a1c5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.580498] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d4b3a48-4963-4afa-b867-26090ac5a1c5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.580729] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d4b3a48-4963-4afa-b867-26090ac5a1c5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.580787] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d4b3a48-4963-4afa-b867-26090ac5a1c5',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.105221] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.106236] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.107055] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.107055] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.107055] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.107055] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d4b3a48-4963-4afa-b867-26090ac5a1c5 already deleted. [ 738.107055] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d4b3a48-4963-4afa-b867-26090ac5a1c5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.902489] env[66502]: INFO networking_nsxv3.common.synchronization [None req-febd535b-f460-49b6-b141-b586988a06a0 None None] Enqueued Resource ID: d9410673-87ef-4d43-a20f-eedbb12f3f36 with Priority: HIGHEST for action port [ 738.903360] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9410673-87ef-4d43-a20f-eedbb12f3f36 with Priority: HIGHEST for action port [ 738.903726] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9410673-87ef-4d43-a20f-eedbb12f3f36 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.903871] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9410673-87ef-4d43-a20f-eedbb12f3f36" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.903938] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9410673-87ef-4d43-a20f-eedbb12f3f36" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.904231] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9410673-87ef-4d43-a20f-eedbb12f3f36" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.904309] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9410673-87ef-4d43-a20f-eedbb12f3f36',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.932460] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 881e7189-5d27-4efb-b9a3-71f2b26c3add in Status: SUCCESS [ 738.932806] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.932965] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.933240] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.933510] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.933675] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.933814] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.934016] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.934113] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.934245] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.934365] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('881e7189-5d27-4efb-b9a3-71f2b26c3add',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.405996] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d9410673-87ef-4d43-a20f-eedbb12f3f36 [ 739.406259] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.406411] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.406487] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.406783] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.406783] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.406894] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d9410673-87ef-4d43-a20f-eedbb12f3f36 already deleted. [ 739.406949] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9410673-87ef-4d43-a20f-eedbb12f3f36" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.410349] env[66502]: INFO networking_nsxv3.common.synchronization [req-ecdd2c5a-5ab1-464b-b3d8-829c5c0afba0 req-1936de5a-cbe6-4248-8bb4-052e5ecdeec7 tempest-ServersAdminTestJSON-292997046 tempest-ServersAdminTestJSON-292997046-project-member] Enqueued Resource ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 with Priority: HIGHEST for action security_group_members [ 739.410922] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 with Priority: HIGHEST for action security_group_members [ 739.411255] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.411386] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.411455] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.411630] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.411777] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.411872] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.412160] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.412304] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.412389] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.412482] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.437102] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-881e7189-5d27-4efb-b9a3-71f2b26c3add taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.437260] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.437616] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.437616] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.437804] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.437804] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.437896] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.437967] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.438060] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.438193] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.438284] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-881e7189-5d27-4efb-b9a3-71f2b26c3add taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.438374] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.438426] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.438714] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.438714] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.438819] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.438847] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.439095] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.439095] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.439171] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.439254] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('881e7189-5d27-4efb-b9a3-71f2b26c3add',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.625040] env[66502]: INFO networking_nsxv3.common.synchronization [None req-c8b9afca-507d-43e4-b07b-5e10b46c235a tempest-AttachVolumeNegativeTest-686526601 tempest-AttachVolumeNegativeTest-686526601-project-member] Enqueued Resource ID: 5988a824-4ff2-477d-8139-5418f9c569e4 with Priority: HIGHEST for action security_group_rules [ 739.626009] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5988a824-4ff2-477d-8139-5418f9c569e4 with Priority: HIGHEST for action security_group_rules [ 739.626363] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5988a824-4ff2-477d-8139-5418f9c569e4 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.626672] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5988a824-4ff2-477d-8139-5418f9c569e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.626672] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5988a824-4ff2-477d-8139-5418f9c569e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.626834] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5988a824-4ff2-477d-8139-5418f9c569e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.626913] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5988a824-4ff2-477d-8139-5418f9c569e4',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.782421] env[66502]: INFO networking_nsxv3.common.synchronization [None req-29f86238-51c1-409e-8e4a-7d9a9b287bc2 tempest-AttachVolumeNegativeTest-686526601 tempest-AttachVolumeNegativeTest-686526601-project-member] Enqueued Resource ID: 5988a824-4ff2-477d-8139-5418f9c569e4 with Priority: HIGHEST for action security_group_rules [ 739.782982] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5988a824-4ff2-477d-8139-5418f9c569e4 with Priority: HIGHEST for action security_group_rules [ 739.783627] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5988a824-4ff2-477d-8139-5418f9c569e4 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.783731] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5988a824-4ff2-477d-8139-5418f9c569e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.889874] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-8 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.890108] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.890228] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.890481] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.890729] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.891491] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.891758] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.892400] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.892726] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.892974] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 739.893109] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 739.893223] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 739.893343] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 739.893455] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 739.893573] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 739.893716] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 739.918253] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.918253] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 739.918253] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 739.918253] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 739.918253] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.918253] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-04f1376c-f971-4cac-92c3-db99419a628b taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.918804] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-04f1376c-f971-4cac-92c3-db99419a628b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.919299] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-04f1376c-f971-4cac-92c3-db99419a628b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.919704] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-04f1376c-f971-4cac-92c3-db99419a628b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.919942] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04f1376c-f971-4cac-92c3-db99419a628b',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.943082] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 881e7189-5d27-4efb-b9a3-71f2b26c3add: rpc.has_security_group_logging(os_id): False [ 739.961423] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.961423] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.961423] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.961423] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.961423] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.961423] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.961423] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.961423] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.961423] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.961423] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.961423] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.961423] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.961423] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.961423] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.961423] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.962085] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.962085] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.962085] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.962085] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.962085] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.962085] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 881e7189-5d27-4efb-b9a3-71f2b26c3add is going to be updated. [ 740.023373] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.023533] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.023584] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.023804] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.023943] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.041725] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 881e7189-5d27-4efb-b9a3-71f2b26c3add in Status: IN_PROGRESS for 2s [ 740.152844] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.152844] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.152844] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.153154] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.153248] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.153427] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5988a824-4ff2-477d-8139-5418f9c569e4 already deleted. [ 740.153561] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5988a824-4ff2-477d-8139-5418f9c569e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.153886] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5988a824-4ff2-477d-8139-5418f9c569e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.154089] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5988a824-4ff2-477d-8139-5418f9c569e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.154089] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5988a824-4ff2-477d-8139-5418f9c569e4',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.425342] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.426585] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.426774] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.426891] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.427192] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.427335] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.427481] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port 04f1376c-f971-4cac-92c3-db99419a628b not found, creating... [ 740.427715] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.427887] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.428362] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.428491] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.428692] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.428969] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.429134] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.429248] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.429447] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.429575] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.429756] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: 04f1376c-f971-4cac-92c3-db99419a628b is going to be created. [ 740.453050] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.453305] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.453382] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.453793] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.454113] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.454357] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-04f1376c-f971-4cac-92c3-db99419a628b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.678398] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.678560] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.678670] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.678885] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.678981] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.679092] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5988a824-4ff2-477d-8139-5418f9c569e4 already deleted. [ 740.679178] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5988a824-4ff2-477d-8139-5418f9c569e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.932067] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.932515] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.932515] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.932711] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.933258] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.933258] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 is going to be updated. [ 740.962111] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.962268] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.962338] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.962555] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.962695] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.971915] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 in Status: IN_PROGRESS for 2s [ 740.979400] env[66502]: INFO networking_nsxv3.common.synchronization [req-edcd2a03-4026-424d-9819-855f857c30ed req-53514116-b6e5-4e97-985e-3c89768e9d7b tempest-ImagesTestJSON-1088460097 tempest-ImagesTestJSON-1088460097-project-member] Enqueued Resource ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 with Priority: HIGHEST for action security_group_members [ 740.979931] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 with Priority: HIGHEST for action security_group_members [ 740.980241] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.980378] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.980441] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.980627] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.980751] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.980880] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.980920] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.981154] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.981287] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.981616] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.150932] env[66502]: INFO networking_nsxv3.common.synchronization [req-ecdd2c5a-5ab1-464b-b3d8-829c5c0afba0 req-921af97d-cb62-42fd-a45f-902704a5cc26 service nova] Enqueued Resource ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 with Priority: HIGHEST for action security_group_rules [ 741.151264] env[66502]: INFO networking_nsxv3.common.synchronization [req-ecdd2c5a-5ab1-464b-b3d8-829c5c0afba0 req-921af97d-cb62-42fd-a45f-902704a5cc26 service nova] Enqueued Resource ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 with Priority: HIGHEST for action security_group_members [ 741.151404] env[66502]: INFO networking_nsxv3.common.synchronization [req-ecdd2c5a-5ab1-464b-b3d8-829c5c0afba0 req-921af97d-cb62-42fd-a45f-902704a5cc26 service nova] Enqueued Resource ID: 04f1376c-f971-4cac-92c3-db99419a628b with Priority: HIGHEST for action port [ 741.151913] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 with Priority: HIGHEST for action security_group_rules [ 741.152069] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 with Priority: HIGHEST for action security_group_members [ 741.152167] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04f1376c-f971-4cac-92c3-db99419a628b with Priority: HIGHEST for action port [ 741.152434] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee2e9577-19ff-440d-9bd8-24dbaf88ea24 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.152563] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.152607] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.155628] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.155628] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.155628] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.155628] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.155628] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-04f1376c-f971-4cac-92c3-db99419a628b taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.155628] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04f1376c-f971-4cac-92c3-db99419a628b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.155628] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04f1376c-f971-4cac-92c3-db99419a628b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.156161] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04f1376c-f971-4cac-92c3-db99419a628b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.156161] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04f1376c-f971-4cac-92c3-db99419a628b',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.489580] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.489580] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.489580] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.489580] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.489580] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.489580] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.489580] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.489580] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.489580] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.489580] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.489580] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 is going to be updated. [ 741.517581] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.518302] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.518924] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.518924] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.518924] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.529386] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 in Status: IN_PROGRESS for 2s [ 741.659313] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.659313] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.659313] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 04f1376c-f971-4cac-92c3-db99419a628b with status ACTIVE [ 741.659313] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.659313] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.659313] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.659313] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.659313] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.659313] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.659313] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.659313] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.659313] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.659313] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.659313] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.659808] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.659808] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.659808] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.659808] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.659808] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 04f1376c-f971-4cac-92c3-db99419a628b is going to be updated. [ 741.682545] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.682689] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.682762] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.682980] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.683130] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.683295] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04f1376c-f971-4cac-92c3-db99419a628b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.046266] env[66502]: INFO networking_nsxv3.common.synchronization [None req-d8e2ec56-213e-4ae1-8e9b-50bc991da513 None None] Enqueued Resource ID: 93505965-4d1e-4998-8693-ba82e34a3e3e with Priority: HIGHEST for action port [ 742.046562] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 93505965-4d1e-4998-8693-ba82e34a3e3e with Priority: HIGHEST for action port [ 742.047129] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-93505965-4d1e-4998-8693-ba82e34a3e3e taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.047252] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-93505965-4d1e-4998-8693-ba82e34a3e3e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.047319] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-93505965-4d1e-4998-8693-ba82e34a3e3e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.047573] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-93505965-4d1e-4998-8693-ba82e34a3e3e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.047654] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('93505965-4d1e-4998-8693-ba82e34a3e3e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.057209] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 881e7189-5d27-4efb-b9a3-71f2b26c3add in Status: SUCCESS [ 742.057443] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.198315] env[66502]: INFO networking_nsxv3.common.synchronization [req-11a071a9-66ec-47c6-846c-31ec330d9734 req-b1ac7ec8-3b88-4e4f-943f-4b35bce166c4 tempest-MultipleCreateTestJSON-1551479830 tempest-MultipleCreateTestJSON-1551479830-project-member] Enqueued Resource ID: 75e42630-d365-4bb0-89c0-55b0baee0268 with Priority: HIGHEST for action security_group_members [ 742.198315] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75e42630-d365-4bb0-89c0-55b0baee0268 with Priority: HIGHEST for action security_group_members [ 742.200137] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e42630-d365-4bb0-89c0-55b0baee0268 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.200137] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.200137] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.200466] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.202349] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.202349] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.202349] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.202349] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.202349] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.202349] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75e42630-d365-4bb0-89c0-55b0baee0268',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.551114] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 93505965-4d1e-4998-8693-ba82e34a3e3e [ 742.551114] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.551271] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.551342] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.551600] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.551695] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.551791] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:93505965-4d1e-4998-8693-ba82e34a3e3e already deleted. [ 742.551885] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-93505965-4d1e-4998-8693-ba82e34a3e3e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.622839] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-458 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.622839] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-458" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.622839] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-458" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.623028] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-458" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.623254] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.623436] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.623556] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.623811] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.624268] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.627367] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 742.627367] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 742.627367] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 742.627367] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 742.627367] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 742.627367] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 742.627367] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 742.647540] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 742.647779] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 742.648044] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 742.650322] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-458" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.650752] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-716214e2-183c-4325-870c-82ee3fad07c2 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.650961] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-716214e2-183c-4325-870c-82ee3fad07c2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.651098] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-716214e2-183c-4325-870c-82ee3fad07c2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.651534] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-716214e2-183c-4325-870c-82ee3fad07c2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.651605] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('716214e2-183c-4325-870c-82ee3fad07c2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.704145] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.704145] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.704145] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.704145] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.704145] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.704434] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.704434] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.704434] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.704601] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.704601] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.705035] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75e42630-d365-4bb0-89c0-55b0baee0268 is going to be updated. [ 742.735165] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.735412] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.735497] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.735710] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.735873] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.747080] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75e42630-d365-4bb0-89c0-55b0baee0268 in Status: IN_PROGRESS for 2s [ 742.985488] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 in Status: SUCCESS [ 742.985694] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.985865] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.986104] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.986741] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.986741] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.986741] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.986741] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.986741] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.986977] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.156049] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.156049] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.156520] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.156520] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.156520] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.156673] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 716214e2-183c-4325-870c-82ee3fad07c2 not found, creating... [ 743.156922] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.157095] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.157205] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.157418] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.157549] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.157846] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.158257] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.158257] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.158355] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.158462] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.158595] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 716214e2-183c-4325-870c-82ee3fad07c2 is going to be created. [ 743.180811] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.181069] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.181212] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.181555] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.181826] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.182680] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-716214e2-183c-4325-870c-82ee3fad07c2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.489487] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.543060] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 in Status: SUCCESS [ 743.543060] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 deletion is rescheduled due to dependency. [ 743.543060] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.971450] env[66502]: INFO networking_nsxv3.common.synchronization [req-11a071a9-66ec-47c6-846c-31ec330d9734 req-10a7569d-d270-4451-bee8-f36f51f35373 service nova] Enqueued Resource ID: 75e42630-d365-4bb0-89c0-55b0baee0268 with Priority: HIGHEST for action security_group_rules [ 743.971618] env[66502]: INFO networking_nsxv3.common.synchronization [req-11a071a9-66ec-47c6-846c-31ec330d9734 req-10a7569d-d270-4451-bee8-f36f51f35373 service nova] Enqueued Resource ID: 75e42630-d365-4bb0-89c0-55b0baee0268 with Priority: HIGHEST for action security_group_members [ 743.971746] env[66502]: INFO networking_nsxv3.common.synchronization [req-11a071a9-66ec-47c6-846c-31ec330d9734 req-10a7569d-d270-4451-bee8-f36f51f35373 service nova] Enqueued Resource ID: 716214e2-183c-4325-870c-82ee3fad07c2 with Priority: HIGHEST for action port [ 743.971981] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75e42630-d365-4bb0-89c0-55b0baee0268 with Priority: HIGHEST for action security_group_rules [ 743.972186] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75e42630-d365-4bb0-89c0-55b0baee0268 with Priority: HIGHEST for action security_group_members [ 743.972232] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 716214e2-183c-4325-870c-82ee3fad07c2 with Priority: HIGHEST for action port [ 743.972765] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75e42630-d365-4bb0-89c0-55b0baee0268 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.973012] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.973012] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.973383] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.973470] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75e42630-d365-4bb0-89c0-55b0baee0268',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.974735] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e42630-d365-4bb0-89c0-55b0baee0268 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.974839] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.975041] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-716214e2-183c-4325-870c-82ee3fad07c2 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.975146] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-716214e2-183c-4325-870c-82ee3fad07c2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.975211] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-716214e2-183c-4325-870c-82ee3fad07c2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.975408] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-716214e2-183c-4325-870c-82ee3fad07c2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.975506] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('716214e2-183c-4325-870c-82ee3fad07c2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.993196] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.475969] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e42630-d365-4bb0-89c0-55b0baee0268 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.476274] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.477542] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 716214e2-183c-4325-870c-82ee3fad07c2 with status ACTIVE [ 744.477739] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.477857] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.477922] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.478152] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.478242] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.478417] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.478512] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.478569] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.478748] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.478828] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.479012] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.479116] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.479160] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.479700] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.479700] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.479700] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 716214e2-183c-4325-870c-82ee3fad07c2 is going to be updated. [ 744.494904] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.495093] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.495160] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.495435] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.495525] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.495623] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 is going to be updated. [ 744.505775] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.505976] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.505976] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.506192] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.506326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.506502] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-716214e2-183c-4325-870c-82ee3fad07c2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.524121] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.524272] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.524340] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.524542] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.524677] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.534791] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 in Status: IN_PROGRESS for 2s [ 744.759683] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75e42630-d365-4bb0-89c0-55b0baee0268 in Status: SUCCESS [ 744.760571] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75e42630-d365-4bb0-89c0-55b0baee0268 deletion is rescheduled due to dependency. [ 744.760571] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.760571] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.760571] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.760785] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.760854] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.760890] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.761998] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.761998] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.761998] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75e42630-d365-4bb0-89c0-55b0baee0268',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.264216] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75e42630-d365-4bb0-89c0-55b0baee0268',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.768034] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75e42630-d365-4bb0-89c0-55b0baee0268',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.270642] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.270810] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.270884] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.271121] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.271885] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.271885] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75e42630-d365-4bb0-89c0-55b0baee0268 is going to be updated. [ 746.307983] env[66502]: INFO networking_nsxv3.common.synchronization [req-11a071a9-66ec-47c6-846c-31ec330d9734 req-dfbc27c2-b32b-4720-8cbc-e2eecc320bca tempest-MultipleCreateTestJSON-1551479830 tempest-MultipleCreateTestJSON-1551479830-project-member] Enqueued Resource ID: 75e42630-d365-4bb0-89c0-55b0baee0268 with Priority: HIGHEST for action security_group_members [ 746.308547] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75e42630-d365-4bb0-89c0-55b0baee0268 with Priority: HIGHEST for action security_group_members [ 746.308848] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e42630-d365-4bb0-89c0-55b0baee0268 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.308949] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.330287] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.330287] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.330287] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.330287] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.330287] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.341113] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75e42630-d365-4bb0-89c0-55b0baee0268 in Status: IN_PROGRESS for 2s [ 746.546383] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 in Status: SUCCESS [ 746.547237] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.547237] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.547237] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.547385] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.547450] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.547493] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.547665] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.547747] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.547830] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.547924] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.650076] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-458 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.650293] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-458" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.650363] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-458" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.650661] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-458" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.652617] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.652617] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.652617] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.652617] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.652617] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.652617] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 746.652617] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 746.652617] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 746.652617] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 746.652617] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 746.652617] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 746.652617] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 746.671962] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 746.672138] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 746.672255] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 746.672414] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-458" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.672758] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-2306fa55-a78e-435b-b606-468e5f0edd11 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.672902] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-2306fa55-a78e-435b-b606-468e5f0edd11" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.672999] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-2306fa55-a78e-435b-b606-468e5f0edd11" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.673358] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-2306fa55-a78e-435b-b606-468e5f0edd11" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.673505] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2306fa55-a78e-435b-b606-468e5f0edd11',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.051881] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.052256] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.052256] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.053639] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.053639] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.053639] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.053639] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.053639] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.053639] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.053639] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.053639] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.054214] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.054214] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.054214] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.054330] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.054330] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.054417] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.054530] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.054610] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.054726] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.054801] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.176223] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.176461] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.176596] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.176905] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.177070] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.177361] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 2306fa55-a78e-435b-b606-468e5f0edd11 not found, creating... [ 747.177485] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.177641] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.177749] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.177970] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.178115] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.178389] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.178537] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.178645] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.178880] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.179021] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.179157] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 2306fa55-a78e-435b-b606-468e5f0edd11 is going to be created. [ 747.204096] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.204356] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.204424] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.204709] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.204956] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.205192] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-2306fa55-a78e-435b-b606-468e5f0edd11" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.326159] env[66502]: INFO networking_nsxv3.common.synchronization [req-10e4b90a-4b81-457b-a481-c7474d5a4335 req-d6f9e432-c82d-4b3c-b4a6-851718afe364 tempest-ServersAdminNegativeTestJSON-39144073 tempest-ServersAdminNegativeTestJSON-39144073-project-member] Enqueued Resource ID: 881e7189-5d27-4efb-b9a3-71f2b26c3add with Priority: HIGHEST for action security_group_members [ 747.326800] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 881e7189-5d27-4efb-b9a3-71f2b26c3add with Priority: HIGHEST for action security_group_members [ 747.327174] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-881e7189-5d27-4efb-b9a3-71f2b26c3add taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.327419] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.327543] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.327773] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.327937] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.328061] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.328125] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.328283] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.328376] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.328477] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('881e7189-5d27-4efb-b9a3-71f2b26c3add',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 747.557028] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ee2e9577-19ff-440d-9bd8-24dbaf88ea24: rpc.has_security_group_logging(os_id): False [ 747.575799] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.575961] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.576048] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.576269] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.576372] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.576580] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.576680] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.576743] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.576893] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.576969] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.577178] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.577280] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.577356] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.577504] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.577579] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.577768] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.577860] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.577922] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.578074] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.578150] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.578234] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 is going to be updated. [ 747.649731] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.649731] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.649731] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.649731] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.649731] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.665423] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 in Status: IN_PROGRESS for 2s [ 747.831471] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('881e7189-5d27-4efb-b9a3-71f2b26c3add',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.003619] env[66502]: INFO networking_nsxv3.common.synchronization [req-11a071a9-66ec-47c6-846c-31ec330d9734 req-9416b65e-bf31-435d-8cd2-ecf1e39f4f9e service nova] Enqueued Resource ID: 75e42630-d365-4bb0-89c0-55b0baee0268 with Priority: HIGHEST for action security_group_rules [ 748.003619] env[66502]: INFO networking_nsxv3.common.synchronization [req-11a071a9-66ec-47c6-846c-31ec330d9734 req-9416b65e-bf31-435d-8cd2-ecf1e39f4f9e service nova] Enqueued Resource ID: 75e42630-d365-4bb0-89c0-55b0baee0268 with Priority: HIGHEST for action security_group_members [ 748.003619] env[66502]: INFO networking_nsxv3.common.synchronization [req-11a071a9-66ec-47c6-846c-31ec330d9734 req-9416b65e-bf31-435d-8cd2-ecf1e39f4f9e service nova] Enqueued Resource ID: 2306fa55-a78e-435b-b606-468e5f0edd11 with Priority: HIGHEST for action port [ 748.003619] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75e42630-d365-4bb0-89c0-55b0baee0268 with Priority: HIGHEST for action security_group_rules [ 748.003619] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75e42630-d365-4bb0-89c0-55b0baee0268 with Priority: HIGHEST for action security_group_members [ 748.003619] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2306fa55-a78e-435b-b606-468e5f0edd11 with Priority: HIGHEST for action port [ 748.003619] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75e42630-d365-4bb0-89c0-55b0baee0268 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.003619] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.003619] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e42630-d365-4bb0-89c0-55b0baee0268 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.003619] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.003619] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-2306fa55-a78e-435b-b606-468e5f0edd11 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.003619] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2306fa55-a78e-435b-b606-468e5f0edd11" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.003619] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2306fa55-a78e-435b-b606-468e5f0edd11" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.003619] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2306fa55-a78e-435b-b606-468e5f0edd11" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.003619] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2306fa55-a78e-435b-b606-468e5f0edd11',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.334018] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('881e7189-5d27-4efb-b9a3-71f2b26c3add',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.354986] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75e42630-d365-4bb0-89c0-55b0baee0268 in Status: SUCCESS [ 748.355539] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.356161] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.356459] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.356638] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.356757] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.356816] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.356976] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.357089] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.357179] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.357276] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('75e42630-d365-4bb0-89c0-55b0baee0268',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.358335] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.358439] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.358579] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.358692] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.358750] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.358940] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.359026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.359109] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75e42630-d365-4bb0-89c0-55b0baee0268',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.503907] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2306fa55-a78e-435b-b606-468e5f0edd11 with status ACTIVE [ 748.504270] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.504556] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.504556] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.504712] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.504802] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.504975] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.505089] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.505252] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.505293] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.505476] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.505635] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.505743] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.505796] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.505934] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.506022] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.506107] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2306fa55-a78e-435b-b606-468e5f0edd11 is going to be updated. [ 748.530260] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.530452] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.530452] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.530696] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.530843] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.531035] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2306fa55-a78e-435b-b606-468e5f0edd11" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.839681] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.839681] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.839681] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.839681] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.839681] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.839681] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 881e7189-5d27-4efb-b9a3-71f2b26c3add is going to be updated. [ 748.861060] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75e42630-d365-4bb0-89c0-55b0baee0268',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 748.862361] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e42630-d365-4bb0-89c0-55b0baee0268 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.862500] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.885770] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 748.885770] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 748.885770] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 748.885770] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 748.886329] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.901207] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 881e7189-5d27-4efb-b9a3-71f2b26c3add in Status: IN_PROGRESS for 2s [ 749.364225] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75e42630-d365-4bb0-89c0-55b0baee0268',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.687590] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 in Status: SUCCESS [ 749.689370] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.709324] env[66502]: INFO networking_nsxv3.common.synchronization [req-c67078de-c1bf-4eba-b0ce-19795ae1602b req-2ad50e3a-f608-439f-a382-017ad57bcc67 tempest-ServersTestManualDisk-1208375570 tempest-ServersTestManualDisk-1208375570-project-member] Enqueued Resource ID: 2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49 with Priority: HIGHEST for action security_group_members [ 749.709869] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49 with Priority: HIGHEST for action security_group_members [ 749.710189] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.710313] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.710398] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.710575] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.710729] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.710818] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.710877] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.713630] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.713847] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.714027] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.866890] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.867044] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.867123] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.867329] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.867446] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.867546] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75e42630-d365-4bb0-89c0-55b0baee0268 is going to be updated. [ 749.901370] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.901613] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.901693] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.902058] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.903690] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.916044] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75e42630-d365-4bb0-89c0-55b0baee0268 in Status: IN_PROGRESS for 2s [ 750.219463] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.219606] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.219682] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.219869] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.219962] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.220307] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.220307] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.220490] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.220490] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.220593] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.220634] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49 is going to be updated. [ 750.258570] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.258715] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.258786] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.259014] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.259163] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.270613] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49 in Status: IN_PROGRESS for 2s [ 750.914817] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 881e7189-5d27-4efb-b9a3-71f2b26c3add in Status: SUCCESS [ 750.915100] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.479826] env[66502]: INFO networking_nsxv3.common.synchronization [req-1dc318e2-1387-4b66-9b1b-0d0ccb85cded req-0aac90e3-89df-4f43-ba32-6e242f8fb8e7 tempest-ServersTestJSON-1210226259 tempest-ServersTestJSON-1210226259-project-member] Enqueued Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_members [ 751.480624] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_members [ 751.480771] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.480899] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.480990] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.481265] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.481386] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.481504] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.481603] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.481772] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.481865] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.481961] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.928526] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75e42630-d365-4bb0-89c0-55b0baee0268 in Status: SUCCESS [ 751.928526] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.928827] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.928916] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.930428] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.930428] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.930428] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.930428] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.930428] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.930428] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75e42630-d365-4bb0-89c0-55b0baee0268',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.935725] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-708 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.935910] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-708" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.936111] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-708" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.936310] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-708" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.936866] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.936866] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.936866] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.937068] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.937196] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.937389] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 751.937490] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 751.937591] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 751.937690] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 751.937804] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 751.937908] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 751.937999] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 751.958119] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 751.958119] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 751.958119] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 751.958119] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-708" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.958394] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-33c6bde8-995d-4bdf-a1d9-b7f2278de666 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.958535] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-33c6bde8-995d-4bdf-a1d9-b7f2278de666" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.958645] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-33c6bde8-995d-4bdf-a1d9-b7f2278de666" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.958955] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-33c6bde8-995d-4bdf-a1d9-b7f2278de666" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.959092] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33c6bde8-995d-4bdf-a1d9-b7f2278de666',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.986496] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.986660] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.986730] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.986951] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.987054] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.987242] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.987369] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.987936] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.987936] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.987936] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.987936] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d226a97-2d69-4706-b98b-565700008c6f already deleted. [ 751.987936] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.282123] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49 in Status: SUCCESS [ 752.282123] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49 deletion is rescheduled due to dependency. [ 752.282123] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.431720] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75e42630-d365-4bb0-89c0-55b0baee0268',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.463034] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.463034] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.463034] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.463034] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.463034] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.463034] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 33c6bde8-995d-4bdf-a1d9-b7f2278de666 not found, creating... [ 752.463034] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.463411] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.463411] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.463475] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.463602] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.463904] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.464081] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.464194] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.464398] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.464526] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.464681] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 33c6bde8-995d-4bdf-a1d9-b7f2278de666 is going to be created. [ 752.486683] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.486894] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.487022] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.489421] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.489682] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.489890] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-33c6bde8-995d-4bdf-a1d9-b7f2278de666" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.933775] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75e42630-d365-4bb0-89c0-55b0baee0268',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.211767] env[66502]: INFO networking_nsxv3.common.synchronization [req-1dc318e2-1387-4b66-9b1b-0d0ccb85cded req-0ed19677-f67a-43d2-a9ad-c2076e111309 service nova] Enqueued Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_rules [ 753.211954] env[66502]: INFO networking_nsxv3.common.synchronization [req-1dc318e2-1387-4b66-9b1b-0d0ccb85cded req-0ed19677-f67a-43d2-a9ad-c2076e111309 service nova] Enqueued Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_members [ 753.212100] env[66502]: INFO networking_nsxv3.common.synchronization [req-1dc318e2-1387-4b66-9b1b-0d0ccb85cded req-0ed19677-f67a-43d2-a9ad-c2076e111309 service nova] Enqueued Resource ID: 33c6bde8-995d-4bdf-a1d9-b7f2278de666 with Priority: HIGHEST for action port [ 753.212841] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_rules [ 753.212841] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_members [ 753.212841] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33c6bde8-995d-4bdf-a1d9-b7f2278de666 with Priority: HIGHEST for action port [ 753.213130] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.213274] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.213414] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.213593] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.213684] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.214475] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.214590] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.214652] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.214814] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.214958] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.215050] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.215153] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.215253] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.215322] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.215444] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.216454] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-33c6bde8-995d-4bdf-a1d9-b7f2278de666 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.216454] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33c6bde8-995d-4bdf-a1d9-b7f2278de666" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.216454] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33c6bde8-995d-4bdf-a1d9-b7f2278de666" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.216712] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33c6bde8-995d-4bdf-a1d9-b7f2278de666" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.216712] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33c6bde8-995d-4bdf-a1d9-b7f2278de666',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.436400] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.437768] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.440021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.440021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.440021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.440021] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75e42630-d365-4bb0-89c0-55b0baee0268 is going to be updated. [ 753.469926] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.471747] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.471945] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.472271] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.472512] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.483338] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75e42630-d365-4bb0-89c0-55b0baee0268 in Status: IN_PROGRESS for 2s [ 753.719377] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.719377] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.719377] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 753.719960] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 33c6bde8-995d-4bdf-a1d9-b7f2278de666 with status ACTIVE [ 753.720149] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.720254] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.720315] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.720511] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.720592] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.723213] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.723606] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.724356] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.724356] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.724356] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.725295] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.726191] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.726282] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.726488] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.726586] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.726722] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 33c6bde8-995d-4bdf-a1d9-b7f2278de666 is going to be updated. [ 753.759456] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.759456] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.759620] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.761642] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.761873] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.762068] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33c6bde8-995d-4bdf-a1d9-b7f2278de666" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.229817] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.731649] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.731726] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.731796] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.732125] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.732359] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.732359] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d226a97-2d69-4706-b98b-565700008c6f is going to be created. [ 754.760637] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.760807] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.760880] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.761111] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.761260] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.774099] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: UNINITIALIZED for 2s [ 755.498477] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75e42630-d365-4bb0-89c0-55b0baee0268 in Status: SUCCESS [ 755.498795] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.498853] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.499064] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.499254] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.499364] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.499446] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.499572] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.500482] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.500482] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.500482] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e42630-d365-4bb0-89c0-55b0baee0268 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.500482] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.500482] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.500482] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.500482] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.500482] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.500482] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.502233] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.502233] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.502233] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.502233] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('75e42630-d365-4bb0-89c0-55b0baee0268',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.003277] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 75e42630-d365-4bb0-89c0-55b0baee0268: rpc.has_security_group_logging(os_id): False [ 756.024477] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.024477] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.024477] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.024648] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.024707] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.024896] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.025011] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.025011] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.025011] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.025011] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.025011] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.025815] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.025815] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.027220] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.027403] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.027677] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.028383] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.028476] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.028679] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.028764] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.028856] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75e42630-d365-4bb0-89c0-55b0baee0268 is going to be updated. [ 756.096695] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.096964] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.097078] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.097774] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.097774] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.117169] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75e42630-d365-4bb0-89c0-55b0baee0268 in Status: IN_PROGRESS for 2s [ 756.786108] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: SUCCESS [ 756.786543] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.786543] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.786829] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.787058] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.787195] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.787289] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.787473] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.787561] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.787648] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.787753] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.290992] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.291182] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.291258] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.291490] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.291664] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.291767] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.291833] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.291978] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.292079] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.292218] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.292309] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.292402] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.292464] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.292598] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.292809] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.292809] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.292881] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.292996] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.293083] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.293165] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.293252] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.796695] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9d226a97-2d69-4706-b98b-565700008c6f: rpc.has_security_group_logging(os_id): False [ 757.822215] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.822469] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.822525] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.822911] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.822911] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.823171] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.823306] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.823349] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.823527] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.823956] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.823956] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.823956] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.824116] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.828645] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.828787] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.829293] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.829293] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.829454] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.829549] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.829652] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.829771] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d226a97-2d69-4706-b98b-565700008c6f is going to be created. [ 757.890783] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.890966] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.891077] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.891367] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.891609] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.905313] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: IN_PROGRESS for 2s [ 758.132298] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75e42630-d365-4bb0-89c0-55b0baee0268 in Status: SUCCESS [ 758.132585] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.132790] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.133031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.133124] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75e42630-d365-4bb0-89c0-55b0baee0268',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.214017] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 758.214017] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 758.635651] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e42630-d365-4bb0-89c0-55b0baee0268 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.635850] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.635955] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.636245] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.636398] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.636502] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.636575] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.636728] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.636815] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.636907] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.636996] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('75e42630-d365-4bb0-89c0-55b0baee0268',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.140741] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e42630-d365-4bb0-89c0-55b0baee0268 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.141107] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.141107] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.141223] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.141398] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.141503] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.141560] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.141716] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.141805] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.141896] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.142057] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e42630-d365-4bb0-89c0-55b0baee0268 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.142152] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.142212] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.142358] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.142499] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.142591] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.142648] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.142785] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.142883] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.142972] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.143078] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('75e42630-d365-4bb0-89c0-55b0baee0268',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.645834] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 75e42630-d365-4bb0-89c0-55b0baee0268: rpc.has_security_group_logging(os_id): False [ 759.668963] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.669138] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.669270] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.669613] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.669613] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.669768] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.669863] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.669972] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.670121] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.670216] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.670442] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.670548] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.670610] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.670843] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.670843] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.671067] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.671204] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.671243] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.671378] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.671473] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.671545] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75e42630-d365-4bb0-89c0-55b0baee0268 is going to be updated. [ 759.759457] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.759641] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.759724] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.759976] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.760157] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.782306] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75e42630-d365-4bb0-89c0-55b0baee0268 in Status: IN_PROGRESS for 2s [ 759.918464] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: SUCCESS [ 759.918885] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.362962] env[66502]: INFO networking_nsxv3.common.synchronization [req-17070bf9-3d9b-4acf-a142-0b953adbc7c1 req-63b50610-3776-48be-a17a-000a1dbece79 tempest-MultipleCreateTestJSON-1551479830 tempest-MultipleCreateTestJSON-1551479830-project-member] Enqueued Resource ID: 75e42630-d365-4bb0-89c0-55b0baee0268 with Priority: HIGHEST for action security_group_members [ 760.364062] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75e42630-d365-4bb0-89c0-55b0baee0268 with Priority: HIGHEST for action security_group_members [ 760.364062] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e42630-d365-4bb0-89c0-55b0baee0268 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.364062] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.364232] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.364311] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.364464] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.364556] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.364613] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.364775] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.364860] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.364954] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75e42630-d365-4bb0-89c0-55b0baee0268',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.450572] env[66502]: INFO networking_nsxv3.common.synchronization [req-705047d1-53bb-48d9-92ac-6e1fa34bc8ac req-4e46afba-203b-460e-b8ad-5694474b0463 tempest-MultipleCreateTestJSON-1551479830 tempest-MultipleCreateTestJSON-1551479830-project-member] Enqueued Resource ID: 75e42630-d365-4bb0-89c0-55b0baee0268 with Priority: HIGHEST for action security_group_members [ 760.451080] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75e42630-d365-4bb0-89c0-55b0baee0268 with Priority: HIGHEST for action security_group_members [ 760.451382] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-75e42630-d365-4bb0-89c0-55b0baee0268 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.451484] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.867888] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75e42630-d365-4bb0-89c0-55b0baee0268',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.370135] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75e42630-d365-4bb0-89c0-55b0baee0268',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.794872] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75e42630-d365-4bb0-89c0-55b0baee0268 in Status: SUCCESS [ 761.795115] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.872120] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.872289] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.872361] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.872588] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.872685] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.872781] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75e42630-d365-4bb0-89c0-55b0baee0268 is going to be updated. [ 761.901413] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.901559] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.901631] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.901854] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.901992] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.911540] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75e42630-d365-4bb0-89c0-55b0baee0268 in Status: IN_PROGRESS for 2s [ 763.926041] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75e42630-d365-4bb0-89c0-55b0baee0268 in Status: SUCCESS [ 763.926041] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.926041] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.926041] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.926041] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.926041] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.926717] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.926717] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.926717] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.926717] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75e42630-d365-4bb0-89c0-55b0baee0268',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.429137] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.429306] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.429381] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.429611] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.429708] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.429908] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.430017] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.430110] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.430352] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.430352] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.430465] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75e42630-d365-4bb0-89c0-55b0baee0268 is going to be updated. [ 764.471531] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.471531] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.471531] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.471531] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.471751] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.483577] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75e42630-d365-4bb0-89c0-55b0baee0268 in Status: IN_PROGRESS for 2s [ 765.451599] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 765.451894] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 765.963479] env[66502]: INFO networking_nsxv3.common.synchronization [None req-64d27638-0bd5-4577-941f-2212201508d8 None None] Enqueued Resource ID: 982110bd-2cb7-4ae2-82a8-78c82145e834 with Priority: HIGHEST for action port [ 765.963975] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 982110bd-2cb7-4ae2-82a8-78c82145e834 with Priority: HIGHEST for action port [ 765.964303] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-982110bd-2cb7-4ae2-82a8-78c82145e834 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.964423] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-982110bd-2cb7-4ae2-82a8-78c82145e834" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.964491] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-982110bd-2cb7-4ae2-82a8-78c82145e834" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.964734] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-982110bd-2cb7-4ae2-82a8-78c82145e834" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.964827] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('982110bd-2cb7-4ae2-82a8-78c82145e834',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.466903] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 982110bd-2cb7-4ae2-82a8-78c82145e834 [ 766.469206] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.469206] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.469206] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.469206] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.469206] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.469206] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:982110bd-2cb7-4ae2-82a8-78c82145e834 already deleted. [ 766.469206] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-982110bd-2cb7-4ae2-82a8-78c82145e834" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.497574] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75e42630-d365-4bb0-89c0-55b0baee0268 in Status: SUCCESS [ 766.497879] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75e42630-d365-4bb0-89c0-55b0baee0268 deletion is rescheduled due to dependency. [ 766.498043] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.575830] env[66502]: INFO networking_nsxv3.common.synchronization [None req-d4379243-8887-4c72-87b1-b64d33311c49 tempest-ServersTestFqdnHostnames-1527225676 tempest-ServersTestFqdnHostnames-1527225676-project-member] Enqueued Resource ID: 6a050294-bf61-423f-b50c-cccbf8fa309f with Priority: HIGHEST for action security_group_rules [ 766.577254] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a050294-bf61-423f-b50c-cccbf8fa309f with Priority: HIGHEST for action security_group_rules [ 766.577254] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a050294-bf61-423f-b50c-cccbf8fa309f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.577254] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a050294-bf61-423f-b50c-cccbf8fa309f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.577254] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a050294-bf61-423f-b50c-cccbf8fa309f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.577254] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a050294-bf61-423f-b50c-cccbf8fa309f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.577493] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a050294-bf61-423f-b50c-cccbf8fa309f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 766.694786] env[66502]: INFO networking_nsxv3.common.synchronization [None req-e4e8b35f-7956-4101-93bb-3f011096eec7 tempest-ServersTestFqdnHostnames-1527225676 tempest-ServersTestFqdnHostnames-1527225676-project-member] Enqueued Resource ID: 6a050294-bf61-423f-b50c-cccbf8fa309f with Priority: HIGHEST for action security_group_rules [ 766.695791] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a050294-bf61-423f-b50c-cccbf8fa309f with Priority: HIGHEST for action security_group_rules [ 766.696138] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a050294-bf61-423f-b50c-cccbf8fa309f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.696236] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a050294-bf61-423f-b50c-cccbf8fa309f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.102707] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.102869] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.103016] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.103664] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.103819] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.103970] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a050294-bf61-423f-b50c-cccbf8fa309f already deleted. [ 767.104239] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a050294-bf61-423f-b50c-cccbf8fa309f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.104440] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a050294-bf61-423f-b50c-cccbf8fa309f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.104658] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a050294-bf61-423f-b50c-cccbf8fa309f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.104782] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a050294-bf61-423f-b50c-cccbf8fa309f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.629697] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.630123] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.630123] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.630412] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.630412] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.630412] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a050294-bf61-423f-b50c-cccbf8fa309f already deleted. [ 767.630412] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a050294-bf61-423f-b50c-cccbf8fa309f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.546977] env[66502]: INFO networking_nsxv3.common.synchronization [None req-8136a989-91d0-479c-b3d4-b2a2796b2f69 None None] Enqueued Resource ID: 0bd9d4a4-a65d-46a8-a92f-057266a1afc3 with Priority: HIGHEST for action port [ 768.547516] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bd9d4a4-a65d-46a8-a92f-057266a1afc3 with Priority: HIGHEST for action port [ 768.547848] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-0bd9d4a4-a65d-46a8-a92f-057266a1afc3 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.548208] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0bd9d4a4-a65d-46a8-a92f-057266a1afc3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.549066] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0bd9d4a4-a65d-46a8-a92f-057266a1afc3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.549347] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0bd9d4a4-a65d-46a8-a92f-057266a1afc3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.549491] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bd9d4a4-a65d-46a8-a92f-057266a1afc3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.040331] env[66502]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] NSXv3 Agent Agent loop - iteration:0 completed [ 769.040331] env[66502]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] NSXv3 Agent Agent loop - iteration:1 started [ 769.053391] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0bd9d4a4-a65d-46a8-a92f-057266a1afc3 [ 769.053391] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.053391] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.053391] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.053391] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.053391] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.053391] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0bd9d4a4-a65d-46a8-a92f-057266a1afc3 already deleted. [ 769.053391] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0bd9d4a4-a65d-46a8-a92f-057266a1afc3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.505492] env[66502]: INFO networking_nsxv3.common.synchronization [req-9a15114b-639c-46d3-916c-1dcda50cd5bb req-160fd005-8c69-4d10-b18e-fa404d6c1cb4 tempest-ServerExternalEventsTest-1301368854 tempest-ServerExternalEventsTest-1301368854-project-member] Enqueued Resource ID: ba4a0494-e0b7-44c9-b74f-00469639644c with Priority: HIGHEST for action security_group_members [ 769.505946] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba4a0494-e0b7-44c9-b74f-00469639644c with Priority: HIGHEST for action security_group_members [ 769.506267] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba4a0494-e0b7-44c9-b74f-00469639644c taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.506389] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba4a0494-e0b7-44c9-b74f-00469639644c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.506460] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba4a0494-e0b7-44c9-b74f-00469639644c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.506744] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba4a0494-e0b7-44c9-b74f-00469639644c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.506871] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.507041] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.507041] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.507323] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.507323] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.507429] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba4a0494-e0b7-44c9-b74f-00469639644c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.877747] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-670 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.877947] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.878081] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.878343] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.878589] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.878947] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.879122] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.879338] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.879478] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.879681] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 769.879870] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 769.879980] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 769.880102] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 769.880209] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 769.880308] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 769.880429] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 769.901639] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 769.901859] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 769.902061] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 769.902274] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.902654] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-f523f483-6c13-4cc9-af16-206f54755345 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.902854] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-f523f483-6c13-4cc9-af16-206f54755345" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.903013] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-f523f483-6c13-4cc9-af16-206f54755345" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.903385] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-f523f483-6c13-4cc9-af16-206f54755345" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.903568] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f523f483-6c13-4cc9-af16-206f54755345',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.010419] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.010764] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.011046] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.011319] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.011416] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.011627] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.011733] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.011797] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.011945] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.012041] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.012117] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba4a0494-e0b7-44c9-b74f-00469639644c already deleted. [ 770.012193] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba4a0494-e0b7-44c9-b74f-00469639644c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.405980] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.406397] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.406397] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.406683] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.406832] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.406982] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port f523f483-6c13-4cc9-af16-206f54755345 not found, creating... [ 770.407255] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.407509] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.407648] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.407875] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.408016] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.408295] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.408449] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.408595] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.409737] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.409737] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.409737] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: f523f483-6c13-4cc9-af16-206f54755345 is going to be created. [ 770.437401] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.439675] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.439874] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.440247] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.445155] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.445155] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-f523f483-6c13-4cc9-af16-206f54755345" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.194418] env[66502]: INFO networking_nsxv3.common.synchronization [req-9a15114b-639c-46d3-916c-1dcda50cd5bb req-8a2a04c3-cf1e-4822-b198-44728a40e990 service nova] Enqueued Resource ID: ba4a0494-e0b7-44c9-b74f-00469639644c with Priority: HIGHEST for action security_group_rules [ 771.194418] env[66502]: INFO networking_nsxv3.common.synchronization [req-9a15114b-639c-46d3-916c-1dcda50cd5bb req-8a2a04c3-cf1e-4822-b198-44728a40e990 service nova] Enqueued Resource ID: ba4a0494-e0b7-44c9-b74f-00469639644c with Priority: HIGHEST for action security_group_members [ 771.194418] env[66502]: INFO networking_nsxv3.common.synchronization [req-9a15114b-639c-46d3-916c-1dcda50cd5bb req-8a2a04c3-cf1e-4822-b198-44728a40e990 service nova] Enqueued Resource ID: f523f483-6c13-4cc9-af16-206f54755345 with Priority: HIGHEST for action port [ 771.194741] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba4a0494-e0b7-44c9-b74f-00469639644c with Priority: HIGHEST for action security_group_rules [ 771.194871] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba4a0494-e0b7-44c9-b74f-00469639644c with Priority: HIGHEST for action security_group_members [ 771.194966] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f523f483-6c13-4cc9-af16-206f54755345 with Priority: HIGHEST for action port [ 771.195658] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba4a0494-e0b7-44c9-b74f-00469639644c taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.195785] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba4a0494-e0b7-44c9-b74f-00469639644c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.195853] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba4a0494-e0b7-44c9-b74f-00469639644c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.196125] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba4a0494-e0b7-44c9-b74f-00469639644c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.196208] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba4a0494-e0b7-44c9-b74f-00469639644c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.197940] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba4a0494-e0b7-44c9-b74f-00469639644c taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.198079] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba4a0494-e0b7-44c9-b74f-00469639644c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.198145] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba4a0494-e0b7-44c9-b74f-00469639644c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.198386] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba4a0494-e0b7-44c9-b74f-00469639644c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.198533] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.198667] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.198734] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.198887] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.198978] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.199435] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba4a0494-e0b7-44c9-b74f-00469639644c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.200739] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-f523f483-6c13-4cc9-af16-206f54755345 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.201029] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f523f483-6c13-4cc9-af16-206f54755345" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.201029] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f523f483-6c13-4cc9-af16-206f54755345" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.201195] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f523f483-6c13-4cc9-af16-206f54755345" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.201271] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f523f483-6c13-4cc9-af16-206f54755345',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.698828] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba4a0494-e0b7-44c9-b74f-00469639644c taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.699232] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba4a0494-e0b7-44c9-b74f-00469639644c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.701302] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ba4a0494-e0b7-44c9-b74f-00469639644c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.702851] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f523f483-6c13-4cc9-af16-206f54755345 with status ACTIVE [ 771.703685] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.703941] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.704066] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.704902] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.704902] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.704902] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.704902] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.704902] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.704902] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.705211] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.705211] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.705299] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.705299] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.705685] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.705685] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.705685] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f523f483-6c13-4cc9-af16-206f54755345 is going to be updated. [ 771.740570] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.740800] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.740800] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.741557] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.741557] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.741557] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f523f483-6c13-4cc9-af16-206f54755345" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.770634] env[66502]: INFO networking_nsxv3.common.synchronization [req-485616d1-38d1-4e0a-94db-ac8da7646b86 req-4e1f1b24-9a64-42b2-a582-70f1064f32ab tempest-FloatingIPsAssociationTestJSON-843355077 tempest-FloatingIPsAssociationTestJSON-843355077-project-member] Enqueued Resource ID: e12852c1-7dc2-4ed2-bd34-e396f9f9256d with Priority: HIGHEST for action security_group_members [ 771.770907] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e12852c1-7dc2-4ed2-bd34-e396f9f9256d with Priority: HIGHEST for action security_group_members [ 771.771253] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.771376] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.771443] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.771652] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.771804] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.771904] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.771965] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.772124] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.772212] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.772307] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e12852c1-7dc2-4ed2-bd34-e396f9f9256d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.911419] env[66502]: INFO networking_nsxv3.common.synchronization [req-27191e91-881c-4f1f-87ae-2632bc1830cc req-70650265-381a-422e-adf9-12c7f880ba16 tempest-ServerRescueTestJSONUnderV235-1015611946 tempest-ServerRescueTestJSONUnderV235-1015611946-project-member] Enqueued Resource ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 with Priority: HIGHEST for action security_group_members [ 771.912146] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 with Priority: HIGHEST for action security_group_members [ 771.912261] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a35d19b-295e-4005-ae0f-c67844fbb164 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.912366] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.912439] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.913563] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.913774] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.913953] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.914432] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.914636] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.914735] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.914833] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a35d19b-295e-4005-ae0f-c67844fbb164',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.207281] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ba4a0494-e0b7-44c9-b74f-00469639644c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.246104] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-21 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.247822] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-21" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.247822] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-21" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.247822] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-21" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.247822] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.247822] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.248211] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.248529] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.248785] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.249458] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 772.249700] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 772.249914] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 772.250256] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 772.252240] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 772.252240] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 772.252240] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 772.271012] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 772.271295] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 772.271377] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 772.271547] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-21" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.272652] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-b4c9b83c-a5d5-408c-b26c-3962eb6ab12e taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.272652] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-b4c9b83c-a5d5-408c-b26c-3962eb6ab12e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.272652] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-b4c9b83c-a5d5-408c-b26c-3962eb6ab12e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.272652] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-b4c9b83c-a5d5-408c-b26c-3962eb6ab12e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.272990] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4c9b83c-a5d5-408c-b26c-3962eb6ab12e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.279401] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.279401] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.279401] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.279401] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.279401] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.279401] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.279401] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.279401] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.279401] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.279401] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.279401] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e12852c1-7dc2-4ed2-bd34-e396f9f9256d is going to be updated. [ 772.315367] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.315367] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.315367] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.317836] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.317836] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.327194] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e12852c1-7dc2-4ed2-bd34-e396f9f9256d in Status: IN_PROGRESS for 2s [ 772.419326] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.419326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.419326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.419326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.419326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.419326] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.419326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.419326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.419326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.419326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.419326] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 already deleted. [ 772.419326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.713578] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.713978] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.713978] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.714060] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.714122] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.714217] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba4a0494-e0b7-44c9-b74f-00469639644c is going to be created. [ 772.738357] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.738577] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.738672] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.738925] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.739144] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.749892] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba4a0494-e0b7-44c9-b74f-00469639644c in Status: UNINITIALIZED for 2s [ 772.775178] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.775422] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.775550] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.776239] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.776239] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.776239] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port b4c9b83c-a5d5-408c-b26c-3962eb6ab12e not found, creating... [ 772.776389] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.776596] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.776665] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.776877] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.777035] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.777362] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.777469] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.777554] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.778116] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.778116] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.778116] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: b4c9b83c-a5d5-408c-b26c-3962eb6ab12e is going to be created. [ 772.802426] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.802700] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.802761] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.803072] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.804191] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.804191] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-b4c9b83c-a5d5-408c-b26c-3962eb6ab12e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.519857] env[66502]: INFO networking_nsxv3.common.synchronization [req-27191e91-881c-4f1f-87ae-2632bc1830cc req-8faeb27c-7b84-41aa-8ab9-fd9ffadf013f service nova] Enqueued Resource ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 with Priority: HIGHEST for action security_group_rules [ 773.520044] env[66502]: INFO networking_nsxv3.common.synchronization [req-27191e91-881c-4f1f-87ae-2632bc1830cc req-8faeb27c-7b84-41aa-8ab9-fd9ffadf013f service nova] Enqueued Resource ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 with Priority: HIGHEST for action security_group_members [ 773.520200] env[66502]: INFO networking_nsxv3.common.synchronization [req-27191e91-881c-4f1f-87ae-2632bc1830cc req-8faeb27c-7b84-41aa-8ab9-fd9ffadf013f service nova] Enqueued Resource ID: b4c9b83c-a5d5-408c-b26c-3962eb6ab12e with Priority: HIGHEST for action port [ 773.520429] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 with Priority: HIGHEST for action security_group_rules [ 773.520556] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 with Priority: HIGHEST for action security_group_members [ 773.520643] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4c9b83c-a5d5-408c-b26c-3962eb6ab12e with Priority: HIGHEST for action port [ 773.523812] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a35d19b-295e-4005-ae0f-c67844fbb164 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.523812] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.523812] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.523812] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.523812] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a35d19b-295e-4005-ae0f-c67844fbb164',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.524969] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a35d19b-295e-4005-ae0f-c67844fbb164 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.525206] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.525206] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.525323] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.525477] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.525606] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.525638] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.525759] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.525853] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.526074] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a35d19b-295e-4005-ae0f-c67844fbb164',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.528170] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4c9b83c-a5d5-408c-b26c-3962eb6ab12e taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.528296] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4c9b83c-a5d5-408c-b26c-3962eb6ab12e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.528351] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4c9b83c-a5d5-408c-b26c-3962eb6ab12e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.528488] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4c9b83c-a5d5-408c-b26c-3962eb6ab12e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.528591] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4c9b83c-a5d5-408c-b26c-3962eb6ab12e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.025959] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a35d19b-295e-4005-ae0f-c67844fbb164 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.025959] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.030414] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4a35d19b-295e-4005-ae0f-c67844fbb164',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.031477] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b4c9b83c-a5d5-408c-b26c-3962eb6ab12e with status ACTIVE [ 774.031685] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.031767] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.032094] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.032094] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.032234] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.032315] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.032402] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.032451] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.032573] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.032646] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.032821] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.032935] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.033046] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.033254] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.033342] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.033468] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b4c9b83c-a5d5-408c-b26c-3962eb6ab12e is going to be updated. [ 774.058640] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.058640] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.058640] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.058915] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.059533] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.059533] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4c9b83c-a5d5-408c-b26c-3962eb6ab12e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.338204] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e12852c1-7dc2-4ed2-bd34-e396f9f9256d in Status: SUCCESS [ 774.338381] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e12852c1-7dc2-4ed2-bd34-e396f9f9256d deletion is rescheduled due to dependency. [ 774.338474] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.535571] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4a35d19b-295e-4005-ae0f-c67844fbb164',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.541277] env[66502]: INFO networking_nsxv3.common.synchronization [req-1ee5ba5d-edc0-4206-ab9f-b2bbb1ab8735 req-35358e39-f9ff-448b-a56b-3e2d0dd8e491 tempest-ListServerFiltersTestJSON-1482878491 tempest-ListServerFiltersTestJSON-1482878491-project-member] Enqueued Resource ID: b96da033-21f1-44bb-a822-a4cb59139771 with Priority: HIGHEST for action security_group_members [ 774.541771] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b96da033-21f1-44bb-a822-a4cb59139771 with Priority: HIGHEST for action security_group_members [ 774.542077] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b96da033-21f1-44bb-a822-a4cb59139771 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.542198] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.542262] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.542513] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.542664] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.542758] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.542819] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.542964] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.544047] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.544763] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b96da033-21f1-44bb-a822-a4cb59139771',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.765053] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba4a0494-e0b7-44c9-b74f-00469639644c in Status: SUCCESS [ 774.765053] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba4a0494-e0b7-44c9-b74f-00469639644c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.765053] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba4a0494-e0b7-44c9-b74f-00469639644c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.765053] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba4a0494-e0b7-44c9-b74f-00469639644c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.765255] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.765255] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.765346] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.765444] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.766034] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.766034] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba4a0494-e0b7-44c9-b74f-00469639644c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.766034] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ba4a0494-e0b7-44c9-b74f-00469639644c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.947534] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-549 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.947726] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-549" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.947865] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-549" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.948194] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-549" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.948438] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.948584] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.948693] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.948900] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.949103] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.949305] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 774.949708] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 774.949880] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 774.949967] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 774.950092] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 774.950193] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 774.950319] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 774.971284] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 774.971417] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 774.971528] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 774.971693] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-549" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.971985] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-2fad89a7-c7d8-4089-96eb-e3afbcf1c9ef taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.972155] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-2fad89a7-c7d8-4089-96eb-e3afbcf1c9ef" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.972258] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-2fad89a7-c7d8-4089-96eb-e3afbcf1c9ef" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.972649] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-2fad89a7-c7d8-4089-96eb-e3afbcf1c9ef" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.972779] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fad89a7-c7d8-4089-96eb-e3afbcf1c9ef',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.042261] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.042261] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.042261] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.042261] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.042261] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.042261] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 is going to be created. [ 775.047391] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.047391] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.047391] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.047391] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.047391] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.047391] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.047867] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.047867] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.047867] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.047867] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.047867] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b96da033-21f1-44bb-a822-a4cb59139771 already deleted. [ 775.048089] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.064769] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.064769] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.064769] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.065066] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.065103] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.075053] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 in Status: UNINITIALIZED for 2s [ 775.271028] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba4a0494-e0b7-44c9-b74f-00469639644c taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.272223] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba4a0494-e0b7-44c9-b74f-00469639644c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.272223] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba4a0494-e0b7-44c9-b74f-00469639644c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.272481] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba4a0494-e0b7-44c9-b74f-00469639644c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.272730] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.272940] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.273161] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.273494] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.273718] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.273862] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba4a0494-e0b7-44c9-b74f-00469639644c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.275508] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba4a0494-e0b7-44c9-b74f-00469639644c taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.275508] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba4a0494-e0b7-44c9-b74f-00469639644c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.275508] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba4a0494-e0b7-44c9-b74f-00469639644c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.275508] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba4a0494-e0b7-44c9-b74f-00469639644c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.275508] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.275508] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.275508] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.275508] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.276184] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.276184] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba4a0494-e0b7-44c9-b74f-00469639644c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.276184] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ba4a0494-e0b7-44c9-b74f-00469639644c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.280090] env[66502]: INFO networking_nsxv3.common.synchronization [None req-9bfb3464-f592-4bc2-917e-c0c64fb51bc1 None None] Enqueued Resource ID: b6ba02b3-f536-4b15-aef8-282302e1b0a5 with Priority: HIGHEST for action port [ 775.280973] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6ba02b3-f536-4b15-aef8-282302e1b0a5 with Priority: HIGHEST for action port [ 775.281507] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6ba02b3-f536-4b15-aef8-282302e1b0a5 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.281855] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6ba02b3-f536-4b15-aef8-282302e1b0a5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.282040] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6ba02b3-f536-4b15-aef8-282302e1b0a5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.284012] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6ba02b3-f536-4b15-aef8-282302e1b0a5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.284247] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6ba02b3-f536-4b15-aef8-282302e1b0a5',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.476693] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.476990] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.477135] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.477447] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.477597] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.477747] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 2fad89a7-c7d8-4089-96eb-e3afbcf1c9ef not found, creating... [ 775.478142] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.478344] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.478513] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.478682] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.478835] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.479148] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.479312] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.479437] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.479646] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.479788] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.479923] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 2fad89a7-c7d8-4089-96eb-e3afbcf1c9ef is going to be created. [ 775.503624] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.503624] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.503922] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.504468] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.504468] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.504645] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-2fad89a7-c7d8-4089-96eb-e3afbcf1c9ef" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.782442] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ba4a0494-e0b7-44c9-b74f-00469639644c: rpc.has_security_group_logging(os_id): False [ 775.788544] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b6ba02b3-f536-4b15-aef8-282302e1b0a5 [ 775.788544] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.788544] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.788544] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.788544] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.788544] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.788544] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b6ba02b3-f536-4b15-aef8-282302e1b0a5 already deleted. [ 775.788544] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6ba02b3-f536-4b15-aef8-282302e1b0a5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.806960] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.807134] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.807185] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.807448] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.807595] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.807797] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.807905] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.807994] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.808146] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.809021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.809021] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.809021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.809021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.809021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.809021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.809021] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.809348] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.809348] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.809490] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.809608] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.809793] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba4a0494-e0b7-44c9-b74f-00469639644c is going to be created. [ 775.875421] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.877781] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.877781] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.877781] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.877781] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.887945] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba4a0494-e0b7-44c9-b74f-00469639644c in Status: IN_PROGRESS for 2s [ 776.267119] env[66502]: INFO networking_nsxv3.common.synchronization [req-1ee5ba5d-edc0-4206-ab9f-b2bbb1ab8735 req-e96cc7d0-c7b3-4236-9399-641aaaeda2dd service nova] Enqueued Resource ID: b96da033-21f1-44bb-a822-a4cb59139771 with Priority: HIGHEST for action security_group_rules [ 776.267119] env[66502]: INFO networking_nsxv3.common.synchronization [req-1ee5ba5d-edc0-4206-ab9f-b2bbb1ab8735 req-e96cc7d0-c7b3-4236-9399-641aaaeda2dd service nova] Enqueued Resource ID: b96da033-21f1-44bb-a822-a4cb59139771 with Priority: HIGHEST for action security_group_members [ 776.267526] env[66502]: INFO networking_nsxv3.common.synchronization [req-1ee5ba5d-edc0-4206-ab9f-b2bbb1ab8735 req-e96cc7d0-c7b3-4236-9399-641aaaeda2dd service nova] Enqueued Resource ID: 2fad89a7-c7d8-4089-96eb-e3afbcf1c9ef with Priority: HIGHEST for action port [ 776.267715] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b96da033-21f1-44bb-a822-a4cb59139771 with Priority: HIGHEST for action security_group_rules [ 776.267851] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b96da033-21f1-44bb-a822-a4cb59139771 with Priority: HIGHEST for action security_group_members [ 776.268013] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2fad89a7-c7d8-4089-96eb-e3afbcf1c9ef with Priority: HIGHEST for action port [ 776.268391] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b96da033-21f1-44bb-a822-a4cb59139771 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.268475] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.268531] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.268856] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.268957] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b96da033-21f1-44bb-a822-a4cb59139771',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.270052] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b96da033-21f1-44bb-a822-a4cb59139771 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.270228] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.270305] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.270488] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.270644] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.270739] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.270797] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.271292] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.271292] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.271292] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b96da033-21f1-44bb-a822-a4cb59139771',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.273442] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-2fad89a7-c7d8-4089-96eb-e3afbcf1c9ef taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.273442] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2fad89a7-c7d8-4089-96eb-e3afbcf1c9ef" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.273442] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2fad89a7-c7d8-4089-96eb-e3afbcf1c9ef" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.273442] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2fad89a7-c7d8-4089-96eb-e3afbcf1c9ef" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.273442] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2fad89a7-c7d8-4089-96eb-e3afbcf1c9ef',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.774624] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b96da033-21f1-44bb-a822-a4cb59139771 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.774807] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.774987] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b96da033-21f1-44bb-a822-a4cb59139771',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.777039] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2fad89a7-c7d8-4089-96eb-e3afbcf1c9ef with status ACTIVE [ 776.777039] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.777039] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.777039] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.777039] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.777039] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.777039] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.777039] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.777039] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.777781] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.777781] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.777781] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.777781] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.777781] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.777781] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.777781] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.777986] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2fad89a7-c7d8-4089-96eb-e3afbcf1c9ef is going to be updated. [ 776.802421] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.802606] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.802647] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.802854] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.802969] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.803137] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2fad89a7-c7d8-4089-96eb-e3afbcf1c9ef" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.085651] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 in Status: SUCCESS [ 777.085888] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.086062] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.086307] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.086484] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.086614] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.086673] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.086826] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.086909] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.086991] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.087094] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4a35d19b-295e-4005-ae0f-c67844fbb164',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.279883] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b96da033-21f1-44bb-a822-a4cb59139771',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.330242] env[66502]: INFO networking_nsxv3.common.synchronization [req-5d89625a-50d8-4cdf-9058-4fc535cf913c req-ffacfe7a-4df3-4ad2-a99b-76ae5ffc085d tempest-ListServerFiltersTestJSON-1482878491 tempest-ListServerFiltersTestJSON-1482878491-project-member] Enqueued Resource ID: b96da033-21f1-44bb-a822-a4cb59139771 with Priority: HIGHEST for action security_group_members [ 777.330242] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b96da033-21f1-44bb-a822-a4cb59139771 with Priority: HIGHEST for action security_group_members [ 777.330242] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b96da033-21f1-44bb-a822-a4cb59139771 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.330242] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.591549] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a35d19b-295e-4005-ae0f-c67844fbb164 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.591549] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.591549] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.591549] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.591549] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.591549] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.591549] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.591939] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.591939] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.592041] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.592436] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a35d19b-295e-4005-ae0f-c67844fbb164 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.592436] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.592436] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.592436] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.593727] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.593727] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.593727] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.593727] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.593727] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.593727] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.593727] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4a35d19b-295e-4005-ae0f-c67844fbb164',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.698224] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-549 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.698430] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-549" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.698552] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-549" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.698810] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-549" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.699079] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.699260] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.699372] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.699585] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.699763] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.699903] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 777.700079] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 777.700185] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 777.700345] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 777.700377] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 777.700475] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 777.700598] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 777.719941] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 777.720125] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 777.720254] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 777.720421] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-549" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.720753] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-66ee3e62-2059-42ed-82f2-6b7facf7e260 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.720947] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-66ee3e62-2059-42ed-82f2-6b7facf7e260" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.721184] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-66ee3e62-2059-42ed-82f2-6b7facf7e260" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.721670] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-66ee3e62-2059-42ed-82f2-6b7facf7e260" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.721735] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66ee3e62-2059-42ed-82f2-6b7facf7e260',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.783166] env[66502]: INFO networking_nsxv3.common.synchronization [None req-51ae5115-1266-4cef-8a4c-1adc866a085c None None] Enqueued Resource ID: bb4f9ae5-2479-4230-9643-c65027857583 with Priority: HIGHEST for action port [ 777.783859] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb4f9ae5-2479-4230-9643-c65027857583 with Priority: HIGHEST for action port [ 777.784245] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb4f9ae5-2479-4230-9643-c65027857583 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.784352] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb4f9ae5-2479-4230-9643-c65027857583" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.784453] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb4f9ae5-2479-4230-9643-c65027857583" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.784687] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb4f9ae5-2479-4230-9643-c65027857583" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.784774] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb4f9ae5-2479-4230-9643-c65027857583',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.786497] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.786632] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.786721] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.786901] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.786998] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.787107] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b96da033-21f1-44bb-a822-a4cb59139771 is going to be created. [ 777.815472] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.815713] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.815885] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.816022] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.816284] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.828108] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b96da033-21f1-44bb-a822-a4cb59139771 in Status: UNINITIALIZED for 2s [ 777.905545] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ba4a0494-e0b7-44c9-b74f-00469639644c in Status: SUCCESS [ 777.905801] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba4a0494-e0b7-44c9-b74f-00469639644c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.098093] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4a35d19b-295e-4005-ae0f-c67844fbb164: rpc.has_security_group_logging(os_id): False [ 778.118667] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.118881] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.118881] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.119131] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.119224] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.119521] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.119618] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.119676] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.119788] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.119870] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.120066] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.120191] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.120191] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.120441] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.120441] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.120645] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.120766] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.120935] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.120935] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.121180] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.121270] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 is going to be created. [ 778.184101] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.184101] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.184101] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.184101] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.184101] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.197536] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 in Status: IN_PROGRESS for 2s [ 778.227258] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.227560] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.227802] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.228148] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.228305] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.228459] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 66ee3e62-2059-42ed-82f2-6b7facf7e260 not found, creating... [ 778.228726] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.228879] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.228988] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.229229] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.229356] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.229633] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.229779] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.229886] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.230133] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.230259] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.230392] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 66ee3e62-2059-42ed-82f2-6b7facf7e260 is going to be created. [ 778.280111] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.280489] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.280489] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.280785] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.281046] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.281288] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-66ee3e62-2059-42ed-82f2-6b7facf7e260" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.287881] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bb4f9ae5-2479-4230-9643-c65027857583 [ 778.287881] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.287881] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.287881] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.288357] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.288357] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.288357] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bb4f9ae5-2479-4230-9643-c65027857583 already deleted. [ 778.288357] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb4f9ae5-2479-4230-9643-c65027857583" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.029042] env[66502]: INFO networking_nsxv3.common.synchronization [req-5d89625a-50d8-4cdf-9058-4fc535cf913c req-0ed11344-2e6b-4c15-afed-a2bdccbf4518 service nova] Enqueued Resource ID: b96da033-21f1-44bb-a822-a4cb59139771 with Priority: HIGHEST for action security_group_rules [ 779.029227] env[66502]: INFO networking_nsxv3.common.synchronization [req-5d89625a-50d8-4cdf-9058-4fc535cf913c req-0ed11344-2e6b-4c15-afed-a2bdccbf4518 service nova] Enqueued Resource ID: b96da033-21f1-44bb-a822-a4cb59139771 with Priority: HIGHEST for action security_group_members [ 779.029350] env[66502]: INFO networking_nsxv3.common.synchronization [req-5d89625a-50d8-4cdf-9058-4fc535cf913c req-0ed11344-2e6b-4c15-afed-a2bdccbf4518 service nova] Enqueued Resource ID: 66ee3e62-2059-42ed-82f2-6b7facf7e260 with Priority: HIGHEST for action port [ 779.030197] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b96da033-21f1-44bb-a822-a4cb59139771 with Priority: HIGHEST for action security_group_rules [ 779.030380] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b96da033-21f1-44bb-a822-a4cb59139771 with Priority: HIGHEST for action security_group_members [ 779.030478] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 66ee3e62-2059-42ed-82f2-6b7facf7e260 with Priority: HIGHEST for action port [ 779.030757] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b96da033-21f1-44bb-a822-a4cb59139771 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.030861] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.031070] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b96da033-21f1-44bb-a822-a4cb59139771 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.031160] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.032112] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-66ee3e62-2059-42ed-82f2-6b7facf7e260 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.032236] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-66ee3e62-2059-42ed-82f2-6b7facf7e260" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.032336] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-66ee3e62-2059-42ed-82f2-6b7facf7e260" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.032577] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-66ee3e62-2059-42ed-82f2-6b7facf7e260" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.032668] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('66ee3e62-2059-42ed-82f2-6b7facf7e260',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.535932] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 66ee3e62-2059-42ed-82f2-6b7facf7e260 with status ACTIVE [ 779.536237] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.536411] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.536458] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.536702] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.536773] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.536952] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.537065] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.537159] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.537277] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.537355] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.537555] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.537721] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.537721] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.537877] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.537954] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.538058] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 66ee3e62-2059-42ed-82f2-6b7facf7e260 is going to be updated. [ 779.561914] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.562077] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.562142] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.562356] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.562490] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.562655] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-66ee3e62-2059-42ed-82f2-6b7facf7e260" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.842255] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b96da033-21f1-44bb-a822-a4cb59139771 in Status: SUCCESS [ 779.842571] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.842816] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.843092] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.843298] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.843448] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.844106] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.844106] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.844106] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.844380] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.844380] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b96da033-21f1-44bb-a822-a4cb59139771',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.846177] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.846177] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.846177] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.846177] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.846177] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.846177] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.846177] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.846177] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b96da033-21f1-44bb-a822-a4cb59139771',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.214231] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 in Status: SUCCESS [ 780.214414] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.349393] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b96da033-21f1-44bb-a822-a4cb59139771 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.349624] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.349722] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b96da033-21f1-44bb-a822-a4cb59139771',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.853297] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b96da033-21f1-44bb-a822-a4cb59139771',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.354772] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.354935] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.355020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.355250] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.355356] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.355477] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b96da033-21f1-44bb-a822-a4cb59139771 is going to be updated. [ 781.393261] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.393404] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.393456] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.393713] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.393850] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.405141] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b96da033-21f1-44bb-a822-a4cb59139771 in Status: IN_PROGRESS for 2s [ 782.190811] env[66502]: INFO networking_nsxv3.common.synchronization [req-1783fd25-ac0e-4fd8-a546-5d2676a64ed5 req-8e547cec-c6c9-4dbf-9446-3c4f8e819e23 tempest-ListServerFiltersTestJSON-1482878491 tempest-ListServerFiltersTestJSON-1482878491-project-member] Enqueued Resource ID: b96da033-21f1-44bb-a822-a4cb59139771 with Priority: HIGHEST for action security_group_members [ 782.191393] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b96da033-21f1-44bb-a822-a4cb59139771 with Priority: HIGHEST for action security_group_members [ 782.192528] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b96da033-21f1-44bb-a822-a4cb59139771 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.192528] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.529894] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-549 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.530091] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-549" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.530209] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-549" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.530471] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-549" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.530717] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.530869] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.530982] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.531200] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.531343] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.531573] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 782.531699] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 782.531803] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 782.531903] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 782.532018] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 782.532119] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 782.532241] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 782.551143] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 782.551321] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 782.551485] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 782.551655] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-549" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.551960] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-a0779d31-6cad-40ae-b900-4073c4fc60ff taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.552139] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-a0779d31-6cad-40ae-b900-4073c4fc60ff" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.552253] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-a0779d31-6cad-40ae-b900-4073c4fc60ff" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.552581] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-a0779d31-6cad-40ae-b900-4073c4fc60ff" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.552730] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0779d31-6cad-40ae-b900-4073c4fc60ff',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.648428] env[66502]: INFO networking_nsxv3.common.synchronization [req-0b52057b-bdb5-4f37-9fac-6f20a3c71f8d req-e9e7f714-9b7a-4ae9-82c7-d062977ba6ba tempest-ServerExternalEventsTest-1301368854 tempest-ServerExternalEventsTest-1301368854-project-member] Enqueued Resource ID: ba4a0494-e0b7-44c9-b74f-00469639644c with Priority: HIGHEST for action security_group_members [ 782.649022] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba4a0494-e0b7-44c9-b74f-00469639644c with Priority: HIGHEST for action security_group_members [ 782.649382] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ba4a0494-e0b7-44c9-b74f-00469639644c taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.649555] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ba4a0494-e0b7-44c9-b74f-00469639644c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.649672] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ba4a0494-e0b7-44c9-b74f-00469639644c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.649926] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ba4a0494-e0b7-44c9-b74f-00469639644c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.650152] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.650307] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.650414] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.650616] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.650760] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.650895] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ba4a0494-e0b7-44c9-b74f-00469639644c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.055730] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.056073] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.056073] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.056352] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.056600] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.056866] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port a0779d31-6cad-40ae-b900-4073c4fc60ff not found, creating... [ 783.057201] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.057344] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.057421] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.057777] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.057777] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.058522] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.058522] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.058522] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.058522] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.058821] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.058853] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: a0779d31-6cad-40ae-b900-4073c4fc60ff is going to be created. [ 783.083855] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.084245] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.084245] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.084454] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.084670] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.084885] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-a0779d31-6cad-40ae-b900-4073c4fc60ff" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.154154] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.154154] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.154154] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.154154] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.154154] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.154457] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.154457] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.154457] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.154574] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.154682] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.155151] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba4a0494-e0b7-44c9-b74f-00469639644c is going to be updated. [ 783.185290] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.185443] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.185573] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.185821] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.185965] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.205195] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba4a0494-e0b7-44c9-b74f-00469639644c in Status: IN_PROGRESS for 2s [ 783.417021] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b96da033-21f1-44bb-a822-a4cb59139771 in Status: SUCCESS [ 783.417253] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.417451] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.417685] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.417914] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.418044] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.418099] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.418263] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.418347] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.418457] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b96da033-21f1-44bb-a822-a4cb59139771',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.805086] env[66502]: INFO networking_nsxv3.common.synchronization [req-1783fd25-ac0e-4fd8-a546-5d2676a64ed5 req-c292eb08-3b10-42ab-88df-55afd7b4f0dd service nova] Enqueued Resource ID: b96da033-21f1-44bb-a822-a4cb59139771 with Priority: HIGHEST for action security_group_rules [ 783.805266] env[66502]: INFO networking_nsxv3.common.synchronization [req-1783fd25-ac0e-4fd8-a546-5d2676a64ed5 req-c292eb08-3b10-42ab-88df-55afd7b4f0dd service nova] Enqueued Resource ID: b96da033-21f1-44bb-a822-a4cb59139771 with Priority: HIGHEST for action security_group_members [ 783.806044] env[66502]: INFO networking_nsxv3.common.synchronization [req-1783fd25-ac0e-4fd8-a546-5d2676a64ed5 req-c292eb08-3b10-42ab-88df-55afd7b4f0dd service nova] Enqueued Resource ID: a0779d31-6cad-40ae-b900-4073c4fc60ff with Priority: HIGHEST for action port [ 783.806249] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b96da033-21f1-44bb-a822-a4cb59139771 with Priority: HIGHEST for action security_group_rules [ 783.806453] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b96da033-21f1-44bb-a822-a4cb59139771 with Priority: HIGHEST for action security_group_members [ 783.806678] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a0779d31-6cad-40ae-b900-4073c4fc60ff with Priority: HIGHEST for action port [ 783.807047] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b96da033-21f1-44bb-a822-a4cb59139771 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.807230] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.807496] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b96da033-21f1-44bb-a822-a4cb59139771 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.807622] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.807887] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-a0779d31-6cad-40ae-b900-4073c4fc60ff taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.808191] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a0779d31-6cad-40ae-b900-4073c4fc60ff" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.808353] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a0779d31-6cad-40ae-b900-4073c4fc60ff" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.808644] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a0779d31-6cad-40ae-b900-4073c4fc60ff" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.808720] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a0779d31-6cad-40ae-b900-4073c4fc60ff',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.924351] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b96da033-21f1-44bb-a822-a4cb59139771',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.312558] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a0779d31-6cad-40ae-b900-4073c4fc60ff with status ACTIVE [ 784.312936] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.313036] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.313107] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.313438] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.313498] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.313684] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.313824] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.313892] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.314073] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.314154] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.314406] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.314517] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.314581] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.314752] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.314825] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.314946] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a0779d31-6cad-40ae-b900-4073c4fc60ff is going to be updated. [ 784.343100] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.343269] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.343338] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.344034] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.344034] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.344034] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a0779d31-6cad-40ae-b900-4073c4fc60ff" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.426466] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b96da033-21f1-44bb-a822-a4cb59139771',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.930228] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.930381] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.930454] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.930672] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.930766] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.930862] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b96da033-21f1-44bb-a822-a4cb59139771 is going to be updated. [ 784.958388] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.958535] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.958829] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.958829] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.959225] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.968640] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b96da033-21f1-44bb-a822-a4cb59139771 in Status: IN_PROGRESS for 2s [ 785.216280] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba4a0494-e0b7-44c9-b74f-00469639644c in Status: IN_PROGRESS for 4s [ 785.848141] env[66502]: INFO networking_nsxv3.common.synchronization [req-d94ce5ed-899e-47fa-8b07-77df26518fd8 req-966057fb-8501-4f5b-9d0b-c152ad28a224 tempest-ServersTestBootFromVolume-1686244991 tempest-ServersTestBootFromVolume-1686244991-project-member] Enqueued Resource ID: eeb100e3-e5a7-4d38-a030-42278dbe1366 with Priority: HIGHEST for action security_group_members [ 785.848718] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eeb100e3-e5a7-4d38-a030-42278dbe1366 with Priority: HIGHEST for action security_group_members [ 785.849043] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-eeb100e3-e5a7-4d38-a030-42278dbe1366 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.849169] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eeb100e3-e5a7-4d38-a030-42278dbe1366" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.849238] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eeb100e3-e5a7-4d38-a030-42278dbe1366" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.849544] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eeb100e3-e5a7-4d38-a030-42278dbe1366" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.849701] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.849797] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.849857] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.850009] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.850101] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.850198] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eeb100e3-e5a7-4d38-a030-42278dbe1366',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.213245] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-151 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.213495] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-151" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.213646] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-151" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.213967] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-151" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.214287] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.214451] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.214582] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.214829] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.214978] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.215228] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 786.215348] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 786.215453] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 786.215602] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 786.215731] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 786.215842] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 786.216021] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 786.237899] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 786.238152] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 786.238294] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 786.238465] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-151" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.238906] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-98dc1dde-c7d8-465d-ac43-a3b1b4641bab taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.239092] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-98dc1dde-c7d8-465d-ac43-a3b1b4641bab" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.239207] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-98dc1dde-c7d8-465d-ac43-a3b1b4641bab" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.239525] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-98dc1dde-c7d8-465d-ac43-a3b1b4641bab" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.239657] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98dc1dde-c7d8-465d-ac43-a3b1b4641bab',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.355923] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.355923] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.355923] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.355923] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.355923] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.355923] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.356236] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.356236] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.356236] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.356333] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.357356] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eeb100e3-e5a7-4d38-a030-42278dbe1366 already deleted. [ 786.357356] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eeb100e3-e5a7-4d38-a030-42278dbe1366" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.742734] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.742966] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.743102] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.743372] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.743535] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.743661] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port 98dc1dde-c7d8-465d-ac43-a3b1b4641bab not found, creating... [ 786.743918] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.744080] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.744189] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.744401] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.744530] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.744901] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.745258] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.745380] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.745637] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.745798] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.745937] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: 98dc1dde-c7d8-465d-ac43-a3b1b4641bab is going to be created. [ 786.772325] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.772534] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.772661] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.772943] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.773185] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.773393] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-98dc1dde-c7d8-465d-ac43-a3b1b4641bab" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.983305] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b96da033-21f1-44bb-a822-a4cb59139771 in Status: SUCCESS [ 786.983305] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.983305] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.983305] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.983305] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.983305] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.983305] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.983305] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.983305] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.983305] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.983305] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b96da033-21f1-44bb-a822-a4cb59139771 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.983305] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.983305] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.983305] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.983305] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.983305] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.983305] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.983305] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.983305] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.984277] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.984277] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b96da033-21f1-44bb-a822-a4cb59139771',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.987106] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.987106] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.987106] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.987106] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.987106] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.987106] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.987106] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.987106] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b96da033-21f1-44bb-a822-a4cb59139771',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.229523] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ba4a0494-e0b7-44c9-b74f-00469639644c in Status: SUCCESS [ 787.229944] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ba4a0494-e0b7-44c9-b74f-00469639644c deletion is rescheduled due to dependency. [ 787.230216] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ba4a0494-e0b7-44c9-b74f-00469639644c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.489451] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b96da033-21f1-44bb-a822-a4cb59139771: rpc.has_security_group_logging(os_id): False [ 787.490891] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b96da033-21f1-44bb-a822-a4cb59139771',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.514091] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.514091] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.514091] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.514091] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.514091] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.514091] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.514091] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.514091] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.514091] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.514091] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.514091] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.514091] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.514091] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.514091] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.514091] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.514668] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.514668] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.514668] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.514668] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.514668] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.514876] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b96da033-21f1-44bb-a822-a4cb59139771 is going to be created. [ 787.522987] env[66502]: INFO networking_nsxv3.common.synchronization [req-d94ce5ed-899e-47fa-8b07-77df26518fd8 req-6e3bff8a-7a4a-4750-921c-8c4ae25774d5 service nova] Enqueued Resource ID: eeb100e3-e5a7-4d38-a030-42278dbe1366 with Priority: HIGHEST for action security_group_rules [ 787.523166] env[66502]: INFO networking_nsxv3.common.synchronization [req-d94ce5ed-899e-47fa-8b07-77df26518fd8 req-6e3bff8a-7a4a-4750-921c-8c4ae25774d5 service nova] Enqueued Resource ID: eeb100e3-e5a7-4d38-a030-42278dbe1366 with Priority: HIGHEST for action security_group_members [ 787.523294] env[66502]: INFO networking_nsxv3.common.synchronization [req-d94ce5ed-899e-47fa-8b07-77df26518fd8 req-6e3bff8a-7a4a-4750-921c-8c4ae25774d5 service nova] Enqueued Resource ID: 98dc1dde-c7d8-465d-ac43-a3b1b4641bab with Priority: HIGHEST for action port [ 787.523980] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eeb100e3-e5a7-4d38-a030-42278dbe1366 with Priority: HIGHEST for action security_group_rules [ 787.524130] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eeb100e3-e5a7-4d38-a030-42278dbe1366 with Priority: HIGHEST for action security_group_members [ 787.524227] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 98dc1dde-c7d8-465d-ac43-a3b1b4641bab with Priority: HIGHEST for action port [ 787.524490] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eeb100e3-e5a7-4d38-a030-42278dbe1366 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.524653] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eeb100e3-e5a7-4d38-a030-42278dbe1366" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.524732] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eeb100e3-e5a7-4d38-a030-42278dbe1366" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.524951] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eeb100e3-e5a7-4d38-a030-42278dbe1366" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.525010] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eeb100e3-e5a7-4d38-a030-42278dbe1366',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.526365] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-eeb100e3-e5a7-4d38-a030-42278dbe1366 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.526521] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eeb100e3-e5a7-4d38-a030-42278dbe1366" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.526624] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eeb100e3-e5a7-4d38-a030-42278dbe1366" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.526920] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eeb100e3-e5a7-4d38-a030-42278dbe1366" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.527695] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.527818] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.527887] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.528060] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.528752] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.528752] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eeb100e3-e5a7-4d38-a030-42278dbe1366',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.529189] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-98dc1dde-c7d8-465d-ac43-a3b1b4641bab taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.529298] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-98dc1dde-c7d8-465d-ac43-a3b1b4641bab" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.529363] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-98dc1dde-c7d8-465d-ac43-a3b1b4641bab" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.529517] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-98dc1dde-c7d8-465d-ac43-a3b1b4641bab" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.529592] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('98dc1dde-c7d8-465d-ac43-a3b1b4641bab',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.602859] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.603018] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.603087] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.603538] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.603730] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.618203] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b96da033-21f1-44bb-a822-a4cb59139771 in Status: IN_PROGRESS for 2s [ 787.993894] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b96da033-21f1-44bb-a822-a4cb59139771',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.031176] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-eeb100e3-e5a7-4d38-a030-42278dbe1366 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.031176] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eeb100e3-e5a7-4d38-a030-42278dbe1366" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.033756] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eeb100e3-e5a7-4d38-a030-42278dbe1366',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.035108] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 98dc1dde-c7d8-465d-ac43-a3b1b4641bab with status ACTIVE [ 788.035165] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.035314] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.035363] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.035707] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.035824] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.036573] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.036573] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.036573] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.036573] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.036573] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.036573] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.037040] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.037040] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.037040] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.037040] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.037040] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 98dc1dde-c7d8-465d-ac43-a3b1b4641bab is going to be updated. [ 788.060427] env[66502]: INFO networking_nsxv3.common.synchronization [req-2696f3a6-0229-4cb3-8f79-255e54b6c0e3 req-0310f5b5-6424-4043-83be-fc9d7e24535f tempest-ServersAdminNegativeTestJSON-39144073 tempest-ServersAdminNegativeTestJSON-39144073-project-member] Enqueued Resource ID: 881e7189-5d27-4efb-b9a3-71f2b26c3add with Priority: HIGHEST for action security_group_members [ 788.061852] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 881e7189-5d27-4efb-b9a3-71f2b26c3add with Priority: HIGHEST for action security_group_members [ 788.062667] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-881e7189-5d27-4efb-b9a3-71f2b26c3add taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.062987] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.062987] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.063839] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.064091] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.064200] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.064331] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.064470] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.064564] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.064662] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('881e7189-5d27-4efb-b9a3-71f2b26c3add',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.068097] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.068291] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.068431] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.068642] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.068811] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.069048] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-98dc1dde-c7d8-465d-ac43-a3b1b4641bab" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.259897] env[66502]: INFO networking_nsxv3.common.synchronization [req-959b07e2-1447-47e0-ae97-a62c22bdf415 req-c413becd-b8ff-4966-8884-3a30720faf2c tempest-DeleteServersTestJSON-51385704 tempest-DeleteServersTestJSON-51385704-project-member] Enqueued Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_members [ 788.260622] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_members [ 788.265114] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-704e5eab-aa44-4493-8c9a-0b24250e7bea taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.265406] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.265541] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.265905] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.266057] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.266161] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.266230] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.266390] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.266483] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.267037] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.496344] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.496344] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.496344] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.496680] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.496680] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.496790] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b96da033-21f1-44bb-a822-a4cb59139771 is going to be updated. [ 788.538884] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.539078] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.539078] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.539402] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.539613] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.541636] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eeb100e3-e5a7-4d38-a030-42278dbe1366',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.554581] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b96da033-21f1-44bb-a822-a4cb59139771 in Status: IN_PROGRESS for 2s [ 788.567816] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.567966] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.568038] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.568336] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.568435] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.568673] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.568784] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.568915] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.569062] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.569179] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.569225] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 881e7189-5d27-4efb-b9a3-71f2b26c3add is going to be updated. [ 788.624190] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.624389] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.624389] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.624606] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.624758] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.638804] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 881e7189-5d27-4efb-b9a3-71f2b26c3add in Status: IN_PROGRESS for 2s [ 788.753918] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-608 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.754194] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-608" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.754273] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-608" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.754570] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-608" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.754964] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.755143] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.755254] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.755466] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.755630] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.755833] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 788.755943] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 788.756064] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 788.756183] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 788.756292] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 788.756391] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 788.756546] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 788.769470] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.769706] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.769789] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.770110] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.770110] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.770336] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.770976] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.770976] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.771363] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.771363] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.771363] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea is going to be updated. [ 788.778471] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 788.778633] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 788.778764] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 788.778930] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-608" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.779294] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-769915b6-64da-446b-86c9-242851c18106 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.779467] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-769915b6-64da-446b-86c9-242851c18106" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.779580] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-769915b6-64da-446b-86c9-242851c18106" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.779930] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-769915b6-64da-446b-86c9-242851c18106" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.780073] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('769915b6-64da-446b-86c9-242851c18106',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.822059] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.822292] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.822292] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.822461] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.822606] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.839090] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: IN_PROGRESS for 2s [ 789.047115] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.047115] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.047115] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.047115] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.047115] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.047115] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eeb100e3-e5a7-4d38-a030-42278dbe1366 is going to be created. [ 789.073935] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.073935] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.073935] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.073935] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.073935] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.084506] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eeb100e3-e5a7-4d38-a030-42278dbe1366 in Status: UNINITIALIZED for 2s [ 789.284693] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.284693] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.284693] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.284935] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.285032] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.285182] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 769915b6-64da-446b-86c9-242851c18106 not found, creating... [ 789.285452] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.285640] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.285758] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.286019] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.286914] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.286914] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.286914] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.286914] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.286914] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.287148] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.287703] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 769915b6-64da-446b-86c9-242851c18106 is going to be created. [ 789.338548] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.338806] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.338884] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.339190] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.339444] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.339701] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-769915b6-64da-446b-86c9-242851c18106" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.629515] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b96da033-21f1-44bb-a822-a4cb59139771 in Status: SUCCESS [ 789.629780] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.629955] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.630220] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.630312] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b96da033-21f1-44bb-a822-a4cb59139771',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.078381] env[66502]: INFO networking_nsxv3.common.synchronization [req-959b07e2-1447-47e0-ae97-a62c22bdf415 req-a116fa4e-87d2-463d-b40b-069181e36cb1 service nova] Enqueued Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_rules [ 790.078911] env[66502]: INFO networking_nsxv3.common.synchronization [req-959b07e2-1447-47e0-ae97-a62c22bdf415 req-a116fa4e-87d2-463d-b40b-069181e36cb1 service nova] Enqueued Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_members [ 790.079148] env[66502]: INFO networking_nsxv3.common.synchronization [req-959b07e2-1447-47e0-ae97-a62c22bdf415 req-a116fa4e-87d2-463d-b40b-069181e36cb1 service nova] Enqueued Resource ID: 769915b6-64da-446b-86c9-242851c18106 with Priority: HIGHEST for action port [ 790.079951] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_rules [ 790.080246] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_members [ 790.080842] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 769915b6-64da-446b-86c9-242851c18106 with Priority: HIGHEST for action port [ 790.080842] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-704e5eab-aa44-4493-8c9a-0b24250e7bea taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.081077] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.081449] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.081486] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.081631] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.082812] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-704e5eab-aa44-4493-8c9a-0b24250e7bea taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.082906] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.083221] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-769915b6-64da-446b-86c9-242851c18106 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.083354] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-769915b6-64da-446b-86c9-242851c18106" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.084050] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-769915b6-64da-446b-86c9-242851c18106" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.084050] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-769915b6-64da-446b-86c9-242851c18106" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.084050] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('769915b6-64da-446b-86c9-242851c18106',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.132666] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b96da033-21f1-44bb-a822-a4cb59139771 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.132820] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.566588] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b96da033-21f1-44bb-a822-a4cb59139771 in Status: SUCCESS [ 790.566835] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.567025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.567262] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.567444] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.567554] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.567613] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.567755] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.567827] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.567919] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b96da033-21f1-44bb-a822-a4cb59139771',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.586936] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-704e5eab-aa44-4493-8c9a-0b24250e7bea taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.588040] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.588040] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 769915b6-64da-446b-86c9-242851c18106 with status ACTIVE [ 790.588480] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.588480] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.588480] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.588480] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.589035] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.589035] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.589035] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.589035] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.589264] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.589264] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.589351] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.589424] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.589473] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.589714] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.589714] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.589884] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 769915b6-64da-446b-86c9-242851c18106 is going to be updated. [ 790.621587] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.621587] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.621587] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.621587] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.621587] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.621587] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-769915b6-64da-446b-86c9-242851c18106" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.651185] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 881e7189-5d27-4efb-b9a3-71f2b26c3add in Status: SUCCESS [ 790.651408] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 881e7189-5d27-4efb-b9a3-71f2b26c3add deletion is rescheduled due to dependency. [ 790.651448] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-881e7189-5d27-4efb-b9a3-71f2b26c3add" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.849644] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: SUCCESS [ 790.850971] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea deletion is rescheduled due to dependency. [ 790.850971] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.850971] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.851272] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.851272] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.852080] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.852080] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.852080] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.852317] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.852317] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.070161] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b96da033-21f1-44bb-a822-a4cb59139771',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.096202] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eeb100e3-e5a7-4d38-a030-42278dbe1366 in Status: SUCCESS [ 791.096555] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eeb100e3-e5a7-4d38-a030-42278dbe1366" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.096683] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eeb100e3-e5a7-4d38-a030-42278dbe1366" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.096918] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eeb100e3-e5a7-4d38-a030-42278dbe1366" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.097164] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.097397] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.097397] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.097682] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.097828] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.097952] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eeb100e3-e5a7-4d38-a030-42278dbe1366" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.098090] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eeb100e3-e5a7-4d38-a030-42278dbe1366',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.204450] env[66502]: INFO networking_nsxv3.common.synchronization [req-2490c61f-4bb8-4aed-8181-0667ae7a2ba1 req-b0260023-2954-4776-86d8-bfcbf9d76f8d tempest-ServersNegativeTestJSON-1444377316 tempest-ServersNegativeTestJSON-1444377316-project-member] Enqueued Resource ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a with Priority: HIGHEST for action security_group_members [ 791.210163] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a with Priority: HIGHEST for action security_group_members [ 791.210163] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ee12fee-49b0-4d1d-b52d-29888a355e8a taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.210163] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.210163] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.210163] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.210163] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.210163] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.210163] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.210163] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.210163] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.210163] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ee12fee-49b0-4d1d-b52d-29888a355e8a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.355418] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.573536] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b96da033-21f1-44bb-a822-a4cb59139771',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.600320] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eeb100e3-e5a7-4d38-a030-42278dbe1366',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.631807] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-431 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.632164] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-431" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.632506] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-431" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.632657] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-431" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.633142] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.633322] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.633451] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.633702] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.633901] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.634120] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 791.634230] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 791.634333] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 791.634433] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 791.634586] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 791.634656] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 791.634782] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 791.659932] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 791.660153] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 791.660352] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 791.660545] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-431" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.660882] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-ff4f4430-32a4-472c-a1ea-06c637098a3e taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.661098] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-ff4f4430-32a4-472c-a1ea-06c637098a3e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.661221] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-ff4f4430-32a4-472c-a1ea-06c637098a3e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.661548] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-ff4f4430-32a4-472c-a1ea-06c637098a3e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.662031] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff4f4430-32a4-472c-a1ea-06c637098a3e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.713128] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ee12fee-49b0-4d1d-b52d-29888a355e8a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.858857] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.078020] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.078259] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.078396] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.078666] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.078779] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.078885] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b96da033-21f1-44bb-a822-a4cb59139771 is going to be updated. [ 792.104511] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eeb100e3-e5a7-4d38-a030-42278dbe1366: rpc.has_security_group_logging(os_id): False [ 792.116999] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.117190] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.117253] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.117435] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.117676] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.122459] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.122459] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.122459] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.122772] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.122772] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.122839] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.122916] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.123135] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.123135] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.123236] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.123280] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eeb100e3-e5a7-4d38-a030-42278dbe1366 is going to be created. [ 792.125753] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b96da033-21f1-44bb-a822-a4cb59139771 in Status: IN_PROGRESS for 2s [ 792.166049] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.166270] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.166392] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.166697] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.166848] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.166994] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port ff4f4430-32a4-472c-a1ea-06c637098a3e not found, creating... [ 792.167252] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.167402] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.167513] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.167721] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.167848] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.168135] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.168285] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.168395] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.168591] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.168743] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.168882] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: ff4f4430-32a4-472c-a1ea-06c637098a3e is going to be created. [ 792.189030] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.189226] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.189314] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.189598] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.189819] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.190045] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-ff4f4430-32a4-472c-a1ea-06c637098a3e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.194155] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.194285] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.194351] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.194539] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.194705] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.205417] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eeb100e3-e5a7-4d38-a030-42278dbe1366 in Status: IN_PROGRESS for 2s [ 792.214961] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ee12fee-49b0-4d1d-b52d-29888a355e8a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.361416] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.361621] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.361621] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.361855] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.361945] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.362103] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea is going to be updated. [ 792.396743] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.397090] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.397235] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.397466] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.397796] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.408524] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: IN_PROGRESS for 2s [ 792.717848] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.718077] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.718150] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.718374] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.718562] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.718562] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a is going to be updated. [ 792.751249] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.753484] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.753484] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.753484] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.753484] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.762790] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a in Status: IN_PROGRESS for 2s [ 792.947652] env[66502]: INFO networking_nsxv3.common.synchronization [req-2490c61f-4bb8-4aed-8181-0667ae7a2ba1 req-a6c2c5cd-10cc-4c9a-b083-097ac9ab543d service nova] Enqueued Resource ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a with Priority: HIGHEST for action security_group_rules [ 792.950028] env[66502]: INFO networking_nsxv3.common.synchronization [req-2490c61f-4bb8-4aed-8181-0667ae7a2ba1 req-a6c2c5cd-10cc-4c9a-b083-097ac9ab543d service nova] Enqueued Resource ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a with Priority: HIGHEST for action security_group_members [ 792.950028] env[66502]: INFO networking_nsxv3.common.synchronization [req-2490c61f-4bb8-4aed-8181-0667ae7a2ba1 req-a6c2c5cd-10cc-4c9a-b083-097ac9ab543d service nova] Enqueued Resource ID: ff4f4430-32a4-472c-a1ea-06c637098a3e with Priority: HIGHEST for action port [ 792.950028] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a with Priority: HIGHEST for action security_group_rules [ 792.950028] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a with Priority: HIGHEST for action security_group_members [ 792.950028] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ff4f4430-32a4-472c-a1ea-06c637098a3e with Priority: HIGHEST for action port [ 792.950028] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ee12fee-49b0-4d1d-b52d-29888a355e8a taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.950028] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.950028] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.950028] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.950870] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ee12fee-49b0-4d1d-b52d-29888a355e8a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.951207] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ee12fee-49b0-4d1d-b52d-29888a355e8a taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.951321] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.951562] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-ff4f4430-32a4-472c-a1ea-06c637098a3e taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.951684] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ff4f4430-32a4-472c-a1ea-06c637098a3e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.952134] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ff4f4430-32a4-472c-a1ea-06c637098a3e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.952134] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ff4f4430-32a4-472c-a1ea-06c637098a3e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.952134] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ff4f4430-32a4-472c-a1ea-06c637098a3e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.457794] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ee12fee-49b0-4d1d-b52d-29888a355e8a taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.458340] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.458340] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ff4f4430-32a4-472c-a1ea-06c637098a3e with status ACTIVE [ 793.458412] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.458457] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.458525] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.458744] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.458850] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.459676] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.459676] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.459676] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.459676] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.459676] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.459676] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.460024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.460024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.460024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.460024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.460196] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ff4f4430-32a4-472c-a1ea-06c637098a3e is going to be updated. [ 793.489209] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.489315] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.489353] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.489572] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.489709] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.489868] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ff4f4430-32a4-472c-a1ea-06c637098a3e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.966819] env[66502]: INFO networking_nsxv3.common.synchronization [req-d6436d30-b88b-438f-840e-be1dfd71bf68 req-3da181e1-109b-4d2e-99fc-348b91a9ee4d tempest-ServersTestMultiNic-1258705533 tempest-ServersTestMultiNic-1258705533-project-member] Enqueued Resource ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 with Priority: HIGHEST for action security_group_members [ 793.967456] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 with Priority: HIGHEST for action security_group_members [ 793.967780] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.968213] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.968213] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.968363] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.968466] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.968531] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.968589] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.968775] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.968883] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.969017] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.139728] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b96da033-21f1-44bb-a822-a4cb59139771 in Status: SUCCESS [ 794.139728] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.139928] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.139974] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.140169] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.140286] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.140350] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.140503] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.140585] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.140689] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.140761] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b96da033-21f1-44bb-a822-a4cb59139771',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.218708] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eeb100e3-e5a7-4d38-a030-42278dbe1366 in Status: SUCCESS [ 794.218708] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eeb100e3-e5a7-4d38-a030-42278dbe1366" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.353075] env[66502]: INFO networking_nsxv3.common.synchronization [req-d6436d30-b88b-438f-840e-be1dfd71bf68 req-7901a619-70bd-46bb-b826-eb8b33c14566 tempest-ServersTestMultiNic-1258705533 tempest-ServersTestMultiNic-1258705533-project-member] Enqueued Resource ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 with Priority: HIGHEST for action security_group_members [ 794.353075] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 with Priority: HIGHEST for action security_group_members [ 794.353586] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.353876] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.429065] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: SUCCESS [ 794.429065] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.429065] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.429065] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.429065] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.429065] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.429065] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.429065] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.429830] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.429991] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.430341] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.471464] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.471958] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.471958] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.471958] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.472181] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.472290] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.472469] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.472541] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.472703] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.472768] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.472862] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 already deleted. [ 794.472942] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.473118] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.473280] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.473485] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.473595] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.473657] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.473799] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.473874] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.473963] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.644262] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b96da033-21f1-44bb-a822-a4cb59139771 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.644430] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.644563] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.644840] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.645065] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.645202] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.645336] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.645583] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.645754] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.645857] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.646036] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b96da033-21f1-44bb-a822-a4cb59139771 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.646178] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.646272] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.646444] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.646658] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.646772] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.646863] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.647771] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.648047] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.648206] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.648348] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b96da033-21f1-44bb-a822-a4cb59139771',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.693989] env[66502]: INFO networking_nsxv3.common.synchronization [req-d6436d30-b88b-438f-840e-be1dfd71bf68 req-0677b8dd-3e4c-49c9-9118-0f46edd1c3a3 tempest-ServersTestMultiNic-1258705533 tempest-ServersTestMultiNic-1258705533-project-member] Enqueued Resource ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 with Priority: HIGHEST for action security_group_members [ 794.694679] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 with Priority: HIGHEST for action security_group_members [ 794.698260] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.698260] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.772703] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a in Status: SUCCESS [ 794.773143] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.773313] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.773563] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.773756] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.773872] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.773937] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.774104] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.774189] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.774285] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ee12fee-49b0-4d1d-b52d-29888a355e8a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.933107] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-704e5eab-aa44-4493-8c9a-0b24250e7bea taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.933288] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.933338] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.933548] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.933741] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.933862] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.933966] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.934094] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.934208] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.934344] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.934541] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-704e5eab-aa44-4493-8c9a-0b24250e7bea taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.934648] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.934714] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.934862] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.935010] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.935104] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.935164] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.935302] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.935377] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.935458] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.935582] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.976387] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.976621] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.976621] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.976886] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.976980] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.977211] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.977349] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.977391] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.977527] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.977606] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.977690] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 already deleted. [ 794.977768] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.978283] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.978424] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.978568] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.978708] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.978774] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.978901] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.978972] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.979289] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.030704] env[66502]: INFO networking_nsxv3.common.synchronization [req-8c1768ea-3a50-46a9-a988-6a7f61a7b167 req-0a2ad6cd-b89c-4bda-a80b-b92df1d2be3b tempest-ServerRescueTestJSONUnderV235-1015611946 tempest-ServerRescueTestJSONUnderV235-1015611946-project-member] Enqueued Resource ID: 4e004dc2-11f0-4594-9c46-b39612e7ec34 with Priority: HIGHEST for action security_group_members [ 795.033087] env[66502]: INFO networking_nsxv3.common.synchronization [req-8c1768ea-3a50-46a9-a988-6a7f61a7b167 req-0a2ad6cd-b89c-4bda-a80b-b92df1d2be3b tempest-ServerRescueTestJSONUnderV235-1015611946 tempest-ServerRescueTestJSONUnderV235-1015611946-project-member] Enqueued Resource ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 with Priority: HIGHEST for action security_group_members [ 795.033087] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e004dc2-11f0-4594-9c46-b39612e7ec34 with Priority: HIGHEST for action security_group_members [ 795.033087] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 with Priority: HIGHEST for action security_group_members [ 795.033087] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e004dc2-11f0-4594-9c46-b39612e7ec34 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.033608] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e004dc2-11f0-4594-9c46-b39612e7ec34" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.033608] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e004dc2-11f0-4594-9c46-b39612e7ec34" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.034192] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e004dc2-11f0-4594-9c46-b39612e7ec34" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.034388] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.034578] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.034697] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.035201] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.035201] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.035329] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e004dc2-11f0-4594-9c46-b39612e7ec34',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.037303] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a35d19b-295e-4005-ae0f-c67844fbb164 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.037534] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.037694] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.037961] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.038619] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.042470] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.042470] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.042470] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.042470] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.042470] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a35d19b-295e-4005-ae0f-c67844fbb164',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.067359] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-791 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.067638] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-791" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.067796] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-791" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.068253] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-791" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.068523] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.068674] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.068846] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.069125] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.069283] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.069487] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 795.069615] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 795.069724] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 795.069839] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 795.069946] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 795.070214] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 795.070261] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 795.085755] env[66502]: INFO networking_nsxv3.common.synchronization [req-8c1768ea-3a50-46a9-a988-6a7f61a7b167 req-0a2ad6cd-b89c-4bda-a80b-b92df1d2be3b tempest-ServerRescueTestJSONUnderV235-1015611946 tempest-ServerRescueTestJSONUnderV235-1015611946-project-member] Enqueued Resource ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 with Priority: HIGHEST for action security_group_rules [ 795.086046] env[66502]: INFO networking_nsxv3.common.synchronization [req-8c1768ea-3a50-46a9-a988-6a7f61a7b167 req-0a2ad6cd-b89c-4bda-a80b-b92df1d2be3b tempest-ServerRescueTestJSONUnderV235-1015611946 tempest-ServerRescueTestJSONUnderV235-1015611946-project-member] Enqueued Resource ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 with Priority: HIGHEST for action security_group_members [ 795.086278] env[66502]: INFO networking_nsxv3.common.synchronization [req-8c1768ea-3a50-46a9-a988-6a7f61a7b167 req-0a2ad6cd-b89c-4bda-a80b-b92df1d2be3b tempest-ServerRescueTestJSONUnderV235-1015611946 tempest-ServerRescueTestJSONUnderV235-1015611946-project-member] Enqueued Resource ID: 4e004dc2-11f0-4594-9c46-b39612e7ec34 with Priority: HIGHEST for action security_group_rules [ 795.086461] env[66502]: INFO networking_nsxv3.common.synchronization [req-8c1768ea-3a50-46a9-a988-6a7f61a7b167 req-0a2ad6cd-b89c-4bda-a80b-b92df1d2be3b tempest-ServerRescueTestJSONUnderV235-1015611946 tempest-ServerRescueTestJSONUnderV235-1015611946-project-member] Enqueued Resource ID: 4e004dc2-11f0-4594-9c46-b39612e7ec34 with Priority: HIGHEST for action security_group_members [ 795.086726] env[66502]: INFO networking_nsxv3.common.synchronization [req-8c1768ea-3a50-46a9-a988-6a7f61a7b167 req-0a2ad6cd-b89c-4bda-a80b-b92df1d2be3b tempest-ServerRescueTestJSONUnderV235-1015611946 tempest-ServerRescueTestJSONUnderV235-1015611946-project-member] Enqueued Resource ID: b4c9b83c-a5d5-408c-b26c-3962eb6ab12e with Priority: HIGHEST for action port [ 795.087434] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 with Priority: HIGHEST for action security_group_rules [ 795.087590] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e004dc2-11f0-4594-9c46-b39612e7ec34 with Priority: HIGHEST for action security_group_rules [ 795.087713] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4c9b83c-a5d5-408c-b26c-3962eb6ab12e with Priority: HIGHEST for action port [ 795.087830] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 with Priority: HIGHEST for action security_group_members [ 795.087955] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e004dc2-11f0-4594-9c46-b39612e7ec34 with Priority: HIGHEST for action security_group_members [ 795.088346] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a35d19b-295e-4005-ae0f-c67844fbb164 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.088521] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.088575] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.088837] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.088936] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a35d19b-295e-4005-ae0f-c67844fbb164',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.090610] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e004dc2-11f0-4594-9c46-b39612e7ec34 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.090797] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e004dc2-11f0-4594-9c46-b39612e7ec34" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.090913] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e004dc2-11f0-4594-9c46-b39612e7ec34" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.091188] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e004dc2-11f0-4594-9c46-b39612e7ec34" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.091283] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e004dc2-11f0-4594-9c46-b39612e7ec34',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.092270] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4c9b83c-a5d5-408c-b26c-3962eb6ab12e taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.092402] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4c9b83c-a5d5-408c-b26c-3962eb6ab12e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.092459] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4c9b83c-a5d5-408c-b26c-3962eb6ab12e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.092665] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4c9b83c-a5d5-408c-b26c-3962eb6ab12e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.092746] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4c9b83c-a5d5-408c-b26c-3962eb6ab12e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.094310] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a35d19b-295e-4005-ae0f-c67844fbb164 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.094420] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.094930] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e004dc2-11f0-4594-9c46-b39612e7ec34 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.095107] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e004dc2-11f0-4594-9c46-b39612e7ec34" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.096502] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 795.096690] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 795.096841] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 795.097053] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-791" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.097840] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-b5331b1b-d84d-4889-8a4b-517e9504f771 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.098160] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-b5331b1b-d84d-4889-8a4b-517e9504f771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.098375] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-b5331b1b-d84d-4889-8a4b-517e9504f771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.098786] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-b5331b1b-d84d-4889-8a4b-517e9504f771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.099307] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5331b1b-d84d-4889-8a4b-517e9504f771',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.150840] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b96da033-21f1-44bb-a822-a4cb59139771: rpc.has_security_group_logging(os_id): False [ 795.171163] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.171376] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.171461] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.171786] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.172014] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.172258] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.172403] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.172472] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.172765] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.172828] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.173021] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.173460] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.173674] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.173957] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.174153] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.174508] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.174667] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.174847] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.175104] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.175275] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.175454] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b96da033-21f1-44bb-a822-a4cb59139771 is going to be updated. [ 795.276040] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.276040] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.276040] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.276468] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.276607] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.277834] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ee12fee-49b0-4d1d-b52d-29888a355e8a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.291080] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b96da033-21f1-44bb-a822-a4cb59139771 in Status: IN_PROGRESS for 2s [ 795.438609] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 704e5eab-aa44-4493-8c9a-0b24250e7bea: rpc.has_security_group_logging(os_id): False [ 795.459140] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.459389] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.459492] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.459807] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.459954] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.460260] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.460407] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.460513] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.461417] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.461417] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.461417] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.461820] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.461936] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.462355] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.462444] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.463447] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.463447] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.463447] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.463447] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.463447] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.463447] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea is going to be updated. [ 795.481238] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.481744] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.481744] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.481744] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.481744] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.482252] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.482252] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.482252] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.482252] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.482618] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.482618] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 already deleted. [ 795.482618] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.544248] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.544248] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.544248] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.544248] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.544248] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.545212] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e004dc2-11f0-4594-9c46-b39612e7ec34',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.546156] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4a35d19b-295e-4005-ae0f-c67844fbb164',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.563506] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: IN_PROGRESS for 2s [ 795.596188] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e004dc2-11f0-4594-9c46-b39612e7ec34 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.596377] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e004dc2-11f0-4594-9c46-b39612e7ec34" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.596575] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a35d19b-295e-4005-ae0f-c67844fbb164 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.596686] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.601609] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.601891] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.602085] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.602322] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.602574] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.602738] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port b5331b1b-d84d-4889-8a4b-517e9504f771 not found, creating... [ 795.602994] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.603163] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.603272] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.603594] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.603698] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.603972] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.604132] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.604240] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.604438] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.604580] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.604744] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: b5331b1b-d84d-4889-8a4b-517e9504f771 is going to be created. [ 795.606265] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b4c9b83c-a5d5-408c-b26c-3962eb6ab12e with status ACTIVE [ 795.606431] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.606568] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.606625] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.606777] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.606864] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.607038] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.607271] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.607357] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.607510] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.607735] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.608026] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.608189] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.608225] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.608358] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.608428] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.608528] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b4c9b83c-a5d5-408c-b26c-3962eb6ab12e is going to be updated. [ 795.636118] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.636444] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.636610] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.636934] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.637212] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.637443] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-b5331b1b-d84d-4889-8a4b-517e9504f771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.639134] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.639262] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.639325] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.639503] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.639625] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.639763] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4c9b83c-a5d5-408c-b26c-3962eb6ab12e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.781557] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ee12fee-49b0-4d1d-b52d-29888a355e8a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 795.941472] env[66502]: INFO networking_nsxv3.common.synchronization [req-a80de2bb-b202-4e67-b50e-be1d2a99fa58 req-81fadc72-40a1-402a-a6db-ac5aeb15d6b7 tempest-ServerRescueTestJSONUnderV235-1015611946 tempest-ServerRescueTestJSONUnderV235-1015611946-project-member] Enqueued Resource ID: 4e004dc2-11f0-4594-9c46-b39612e7ec34 with Priority: HIGHEST for action security_group_members [ 795.942366] env[66502]: INFO networking_nsxv3.common.synchronization [req-a80de2bb-b202-4e67-b50e-be1d2a99fa58 req-81fadc72-40a1-402a-a6db-ac5aeb15d6b7 tempest-ServerRescueTestJSONUnderV235-1015611946 tempest-ServerRescueTestJSONUnderV235-1015611946-project-member] Enqueued Resource ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 with Priority: HIGHEST for action security_group_members [ 795.942607] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e004dc2-11f0-4594-9c46-b39612e7ec34 with Priority: HIGHEST for action security_group_members [ 795.942742] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 with Priority: HIGHEST for action security_group_members [ 795.943026] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e004dc2-11f0-4594-9c46-b39612e7ec34 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.943691] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e004dc2-11f0-4594-9c46-b39612e7ec34" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.943691] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a35d19b-295e-4005-ae0f-c67844fbb164 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.943691] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.990302] env[66502]: INFO networking_nsxv3.common.synchronization [req-a80de2bb-b202-4e67-b50e-be1d2a99fa58 req-81fadc72-40a1-402a-a6db-ac5aeb15d6b7 tempest-ServerRescueTestJSONUnderV235-1015611946 tempest-ServerRescueTestJSONUnderV235-1015611946-project-member] Enqueued Resource ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 with Priority: HIGHEST for action security_group_rules [ 795.990498] env[66502]: INFO networking_nsxv3.common.synchronization [req-a80de2bb-b202-4e67-b50e-be1d2a99fa58 req-81fadc72-40a1-402a-a6db-ac5aeb15d6b7 tempest-ServerRescueTestJSONUnderV235-1015611946 tempest-ServerRescueTestJSONUnderV235-1015611946-project-member] Enqueued Resource ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 with Priority: HIGHEST for action security_group_members [ 795.990625] env[66502]: INFO networking_nsxv3.common.synchronization [req-a80de2bb-b202-4e67-b50e-be1d2a99fa58 req-81fadc72-40a1-402a-a6db-ac5aeb15d6b7 tempest-ServerRescueTestJSONUnderV235-1015611946 tempest-ServerRescueTestJSONUnderV235-1015611946-project-member] Enqueued Resource ID: b4c9b83c-a5d5-408c-b26c-3962eb6ab12e with Priority: HIGHEST for action port [ 795.991325] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 with Priority: HIGHEST for action security_group_rules [ 795.991463] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 with Priority: HIGHEST for action security_group_members [ 795.991573] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4c9b83c-a5d5-408c-b26c-3962eb6ab12e with Priority: HIGHEST for action port [ 795.991874] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4a35d19b-295e-4005-ae0f-c67844fbb164 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.991984] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.992163] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a35d19b-295e-4005-ae0f-c67844fbb164 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.992249] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.992432] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4c9b83c-a5d5-408c-b26c-3962eb6ab12e taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.992519] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4c9b83c-a5d5-408c-b26c-3962eb6ab12e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.992579] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4c9b83c-a5d5-408c-b26c-3962eb6ab12e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.992785] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4c9b83c-a5d5-408c-b26c-3962eb6ab12e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.992867] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4c9b83c-a5d5-408c-b26c-3962eb6ab12e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.047615] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e004dc2-11f0-4594-9c46-b39612e7ec34',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.049846] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4a35d19b-295e-4005-ae0f-c67844fbb164',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.284274] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.284456] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.284547] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.284766] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.286398] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.286398] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a is going to be updated. [ 796.320463] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.320656] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.320700] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.320913] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.321071] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.331919] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a in Status: IN_PROGRESS for 2s [ 796.357141] env[66502]: INFO networking_nsxv3.common.synchronization [req-d6436d30-b88b-438f-840e-be1dfd71bf68 req-a93ccf5a-3072-4329-a2a0-38a014db6289 service nova] Enqueued Resource ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 with Priority: HIGHEST for action security_group_rules [ 796.357325] env[66502]: INFO networking_nsxv3.common.synchronization [req-d6436d30-b88b-438f-840e-be1dfd71bf68 req-a93ccf5a-3072-4329-a2a0-38a014db6289 service nova] Enqueued Resource ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 with Priority: HIGHEST for action security_group_members [ 796.357460] env[66502]: INFO networking_nsxv3.common.synchronization [req-d6436d30-b88b-438f-840e-be1dfd71bf68 req-a93ccf5a-3072-4329-a2a0-38a014db6289 service nova] Enqueued Resource ID: b5331b1b-d84d-4889-8a4b-517e9504f771 with Priority: HIGHEST for action port [ 796.357990] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 with Priority: HIGHEST for action security_group_rules [ 796.358158] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 with Priority: HIGHEST for action security_group_members [ 796.358252] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b5331b1b-d84d-4889-8a4b-517e9504f771 with Priority: HIGHEST for action port [ 796.358515] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0bae9bdb-dcb4-4110-bcb0-1b0548a94738 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.358635] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.358715] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.358983] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.359106] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.360011] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.360609] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.360609] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.360609] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.360609] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.360893] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.360893] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.360893] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.361624] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.361624] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.362372] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-b5331b1b-d84d-4889-8a4b-517e9504f771 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.362372] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b5331b1b-d84d-4889-8a4b-517e9504f771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.362372] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b5331b1b-d84d-4889-8a4b-517e9504f771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.362372] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b5331b1b-d84d-4889-8a4b-517e9504f771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.362372] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b5331b1b-d84d-4889-8a4b-517e9504f771',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.495797] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b4c9b83c-a5d5-408c-b26c-3962eb6ab12e with status ACTIVE [ 796.496107] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.496170] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.496397] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.498111] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.498218] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.498415] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.498524] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.498593] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.498759] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.498845] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.499071] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.499189] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.499245] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.499389] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.499450] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.499536] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b4c9b83c-a5d5-408c-b26c-3962eb6ab12e is going to be updated. [ 796.522295] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.522474] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.522539] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.522698] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.522828] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.522983] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4c9b83c-a5d5-408c-b26c-3962eb6ab12e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.549604] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.549762] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.549832] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.550174] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.550271] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.550371] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e004dc2-11f0-4594-9c46-b39612e7ec34 is going to be created. [ 796.551672] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.551812] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.551883] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.552069] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.552139] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.552218] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 is going to be updated. [ 796.578181] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.578409] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.578528] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.578844] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.579090] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.581541] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.581675] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.581753] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.581935] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.582120] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.591471] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 in Status: IN_PROGRESS for 2s [ 796.592178] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e004dc2-11f0-4594-9c46-b39612e7ec34 in Status: UNINITIALIZED for 2s [ 796.865041] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.865250] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.865298] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.866657] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b5331b1b-d84d-4889-8a4b-517e9504f771 with status ACTIVE [ 796.866900] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.867040] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.867170] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.867324] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.867402] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.867629] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.867742] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.867742] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.867871] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.867943] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.868148] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.868275] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.868345] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.868411] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.868695] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.868695] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b5331b1b-d84d-4889-8a4b-517e9504f771 is going to be updated. [ 796.896280] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.896280] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.896280] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.896439] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.896474] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.896629] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b5331b1b-d84d-4889-8a4b-517e9504f771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.175034] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-451 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.175034] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-451" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.175034] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-451" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.175282] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-451" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.176392] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.176392] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.176535] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.177177] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.177177] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.177177] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 797.177177] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 797.177364] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 797.177364] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 797.177452] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 797.177556] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 797.177706] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 797.197275] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 797.197437] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 797.197498] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 797.197713] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-451" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.198024] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-bfda7373-783a-49f1-b07e-559ec312d6d0 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.198204] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-bfda7373-783a-49f1-b07e-559ec312d6d0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.198316] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-bfda7373-783a-49f1-b07e-559ec312d6d0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.198709] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-bfda7373-783a-49f1-b07e-559ec312d6d0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.198929] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfda7373-783a-49f1-b07e-559ec312d6d0',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.305792] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b96da033-21f1-44bb-a822-a4cb59139771 in Status: SUCCESS [ 797.306053] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.306243] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.306470] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.306551] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b96da033-21f1-44bb-a822-a4cb59139771',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.370816] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.576079] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: SUCCESS [ 797.576079] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.703665] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.704217] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.704217] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.704342] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.704448] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.704589] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port bfda7373-783a-49f1-b07e-559ec312d6d0 not found, creating... [ 797.704862] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.705000] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.705720] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.705720] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.705720] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.705868] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.705944] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.706133] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.706364] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.706514] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.706643] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: bfda7373-783a-49f1-b07e-559ec312d6d0 is going to be created. [ 797.727688] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.727905] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.728028] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.728444] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.728709] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.728932] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-bfda7373-783a-49f1-b07e-559ec312d6d0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.809444] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b96da033-21f1-44bb-a822-a4cb59139771 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.809660] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.809706] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.809964] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.810148] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.810271] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.810333] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.810493] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.810600] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.810694] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.810803] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b96da033-21f1-44bb-a822-a4cb59139771',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.875156] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.875500] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.875500] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.875930] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.875930] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.876084] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 is going to be created. [ 797.924883] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.925121] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.925121] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.925340] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.925503] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.939528] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 in Status: UNINITIALIZED for 2s [ 798.316500] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b96da033-21f1-44bb-a822-a4cb59139771 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.316500] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.316500] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.316500] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.316500] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.316500] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.316500] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.316500] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.316500] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.316500] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.316500] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b96da033-21f1-44bb-a822-a4cb59139771 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.316500] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.316500] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.316500] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.318208] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.318621] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.318895] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.319307] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.319857] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.320201] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.321042] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b96da033-21f1-44bb-a822-a4cb59139771',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.347218] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a in Status: SUCCESS [ 798.347218] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.347218] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.347218] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.347218] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.348685] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.348810] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.348936] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.349034] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.349125] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.349217] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ee12fee-49b0-4d1d-b52d-29888a355e8a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.497201] env[66502]: INFO networking_nsxv3.common.synchronization [req-d6436d30-b88b-438f-840e-be1dfd71bf68 req-d4e10147-bbc0-45b6-97ad-9c2a77e46ea1 service nova] Enqueued Resource ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 with Priority: HIGHEST for action security_group_rules [ 798.497543] env[66502]: INFO networking_nsxv3.common.synchronization [req-d6436d30-b88b-438f-840e-be1dfd71bf68 req-d4e10147-bbc0-45b6-97ad-9c2a77e46ea1 service nova] Enqueued Resource ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 with Priority: HIGHEST for action security_group_members [ 798.497794] env[66502]: INFO networking_nsxv3.common.synchronization [req-d6436d30-b88b-438f-840e-be1dfd71bf68 req-d4e10147-bbc0-45b6-97ad-9c2a77e46ea1 service nova] Enqueued Resource ID: bfda7373-783a-49f1-b07e-559ec312d6d0 with Priority: HIGHEST for action port [ 798.498566] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 with Priority: HIGHEST for action security_group_rules [ 798.498838] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 with Priority: HIGHEST for action security_group_members [ 798.500102] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bfda7373-783a-49f1-b07e-559ec312d6d0 with Priority: HIGHEST for action port [ 798.500102] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0bae9bdb-dcb4-4110-bcb0-1b0548a94738 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.500102] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.500102] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.500102] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.500372] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-bfda7373-783a-49f1-b07e-559ec312d6d0 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.500502] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bfda7373-783a-49f1-b07e-559ec312d6d0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.500739] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bfda7373-783a-49f1-b07e-559ec312d6d0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.500940] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bfda7373-783a-49f1-b07e-559ec312d6d0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.501107] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bfda7373-783a-49f1-b07e-559ec312d6d0',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.603226] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 in Status: SUCCESS [ 798.604480] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.604480] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e004dc2-11f0-4594-9c46-b39612e7ec34 in Status: SUCCESS [ 798.604480] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e004dc2-11f0-4594-9c46-b39612e7ec34" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.604738] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.604791] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.604950] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.605198] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.605198] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.605330] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.605366] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.605455] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a35d19b-295e-4005-ae0f-c67844fbb164',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.607580] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e004dc2-11f0-4594-9c46-b39612e7ec34" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.609171] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e004dc2-11f0-4594-9c46-b39612e7ec34" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.609760] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.610439] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.610439] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.610439] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.610439] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.610634] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e004dc2-11f0-4594-9c46-b39612e7ec34',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.825063] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b96da033-21f1-44bb-a822-a4cb59139771: rpc.has_security_group_logging(os_id): False [ 798.847387] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.847628] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.847721] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.848107] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.848211] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.848596] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.848682] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.848735] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.848937] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.849041] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.849265] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.849365] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.849439] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.849601] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.849701] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.849888] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.850022] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.850577] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.850773] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.850863] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.850960] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b96da033-21f1-44bb-a822-a4cb59139771 is going to be updated. [ 798.853411] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ee12fee-49b0-4d1d-b52d-29888a355e8a taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.853548] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.853650] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.853826] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.855276] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.855441] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.855524] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.855762] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.855853] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.855943] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.856525] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ee12fee-49b0-4d1d-b52d-29888a355e8a taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.856682] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.856731] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.856878] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.857036] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.857134] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.857201] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.857346] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.857454] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.858233] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.858233] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ee12fee-49b0-4d1d-b52d-29888a355e8a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.936870] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.937101] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.937217] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.937487] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.937689] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.952024] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b96da033-21f1-44bb-a822-a4cb59139771 in Status: IN_PROGRESS for 2s [ 799.003691] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bfda7373-783a-49f1-b07e-559ec312d6d0 with status ACTIVE [ 799.003947] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.004026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.004095] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.004331] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.004426] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.007442] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.007442] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.007442] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.007442] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.007442] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.007442] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.007442] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.007442] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.007442] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.007442] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.007442] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bfda7373-783a-49f1-b07e-559ec312d6d0 is going to be updated. [ 799.043678] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.043884] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.043932] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.044192] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.044309] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.044509] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bfda7373-783a-49f1-b07e-559ec312d6d0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.112700] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4a35d19b-295e-4005-ae0f-c67844fbb164',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.115167] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.115167] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.115167] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.121176] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.121446] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.121661] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.121778] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.121841] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.122095] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.122175] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.122264] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e004dc2-11f0-4594-9c46-b39612e7ec34 is going to be deleted. [ 799.209077] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.209265] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.210029] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.210029] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.210029] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.210029] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e004dc2-11f0-4594-9c46-b39612e7ec34" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.210251] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e004dc2-11f0-4594-9c46-b39612e7ec34" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.210323] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e004dc2-11f0-4594-9c46-b39612e7ec34" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.210770] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.210770] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.210770] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.211042] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.211042] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.211672] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e004dc2-11f0-4594-9c46-b39612e7ec34',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.360447] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ee12fee-49b0-4d1d-b52d-29888a355e8a: rpc.has_security_group_logging(os_id): False [ 799.392206] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.392206] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.392206] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.392206] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.392206] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.392206] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.392206] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.392206] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.392206] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.392206] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.392206] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.392206] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.392206] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.392206] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.392206] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.393058] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.393058] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.393058] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.393058] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.393058] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.393058] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a is going to be updated. [ 799.419441] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-791 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.419441] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-791" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.419441] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-791" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.419441] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-791" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.419441] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.419441] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.420023] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.420023] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.420023] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.420023] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 799.420363] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 799.420363] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 799.420363] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 799.420526] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 799.420526] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 799.421589] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 799.443648] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 799.443848] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 799.443967] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 799.444183] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-791" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.444517] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-5326e5f8-d9c2-4aee-bce9-eb015451ed9b taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.444685] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-5326e5f8-d9c2-4aee-bce9-eb015451ed9b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.444796] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-5326e5f8-d9c2-4aee-bce9-eb015451ed9b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.445141] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-5326e5f8-d9c2-4aee-bce9-eb015451ed9b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.445277] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5326e5f8-d9c2-4aee-bce9-eb015451ed9b',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.479774] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.480037] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.480162] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.480444] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.480645] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.495998] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a in Status: IN_PROGRESS for 2s [ 799.627032] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4a35d19b-295e-4005-ae0f-c67844fbb164',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.718026] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.718026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.718026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.718026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.718026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.718026] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.718026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.718026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.718026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.718026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.718026] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e004dc2-11f0-4594-9c46-b39612e7ec34 already deleted. [ 799.718026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e004dc2-11f0-4594-9c46-b39612e7ec34" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.718026] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e004dc2-11f0-4594-9c46-b39612e7ec34',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.718026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e004dc2-11f0-4594-9c46-b39612e7ec34" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.718026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e004dc2-11f0-4594-9c46-b39612e7ec34" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.718026] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.718965] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.718965] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.718965] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.718965] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.718965] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e004dc2-11f0-4594-9c46-b39612e7ec34',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.952096] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 in Status: SUCCESS [ 799.952096] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.952096] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.952096] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.952096] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.952096] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.952096] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.952096] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 5326e5f8-d9c2-4aee-bce9-eb015451ed9b not found, creating... [ 799.952856] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.956025] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.956025] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.956025] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.956025] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.956025] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.956025] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.956025] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.956025] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.956025] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.956025] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 5326e5f8-d9c2-4aee-bce9-eb015451ed9b is going to be created. [ 799.960823] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.960823] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.960823] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.960823] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.960823] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.960823] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.960823] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.960823] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.960823] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.960823] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.960823] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.960823] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.960823] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.960823] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.960823] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.960823] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.960823] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.991092] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.991403] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.992435] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.992435] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.992435] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.992435] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-5326e5f8-d9c2-4aee-bce9-eb015451ed9b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.131884] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.132111] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.132181] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.132417] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.132518] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.132678] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 is going to be updated. [ 800.181392] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.181616] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.181616] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.181829] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.181978] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.193449] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 in Status: IN_PROGRESS for 2s [ 800.221722] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e004dc2-11f0-4594-9c46-b39612e7ec34',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.222865] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.223047] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.223144] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.223405] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.223561] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.223773] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.223907] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.223990] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.224208] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.224307] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.224415] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e004dc2-11f0-4594-9c46-b39612e7ec34 already deleted. [ 800.224518] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e004dc2-11f0-4594-9c46-b39612e7ec34" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.463243] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.463404] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.463615] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.719745] env[66502]: INFO networking_nsxv3.common.synchronization [req-d6436d30-b88b-438f-840e-be1dfd71bf68 req-71c352f9-0776-480f-a325-6cfca03c6ec6 service nova] Enqueued Resource ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 with Priority: HIGHEST for action security_group_rules [ 800.719745] env[66502]: INFO networking_nsxv3.common.synchronization [req-d6436d30-b88b-438f-840e-be1dfd71bf68 req-71c352f9-0776-480f-a325-6cfca03c6ec6 service nova] Enqueued Resource ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 with Priority: HIGHEST for action security_group_members [ 800.719745] env[66502]: INFO networking_nsxv3.common.synchronization [req-d6436d30-b88b-438f-840e-be1dfd71bf68 req-71c352f9-0776-480f-a325-6cfca03c6ec6 service nova] Enqueued Resource ID: 5326e5f8-d9c2-4aee-bce9-eb015451ed9b with Priority: HIGHEST for action port [ 800.720209] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 with Priority: HIGHEST for action security_group_rules [ 800.720365] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 with Priority: HIGHEST for action security_group_members [ 800.720467] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5326e5f8-d9c2-4aee-bce9-eb015451ed9b with Priority: HIGHEST for action port [ 800.720888] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0bae9bdb-dcb4-4110-bcb0-1b0548a94738 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.720888] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.721391] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.721391] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.721516] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-5326e5f8-d9c2-4aee-bce9-eb015451ed9b taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.721631] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5326e5f8-d9c2-4aee-bce9-eb015451ed9b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.721631] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5326e5f8-d9c2-4aee-bce9-eb015451ed9b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.721804] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5326e5f8-d9c2-4aee-bce9-eb015451ed9b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.721944] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5326e5f8-d9c2-4aee-bce9-eb015451ed9b',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.728325] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e004dc2-11f0-4594-9c46-b39612e7ec34: rpc.has_security_group_logging(os_id): False [ 800.747230] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.750021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.750021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.750021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.750021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.750021] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.750021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.750021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.750021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.750021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.750021] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e004dc2-11f0-4594-9c46-b39612e7ec34 is going to be created. [ 800.770087] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/4e004dc2-11f0-4594-9c46-b39612e7ec34], does not exist path=[/infra/domains/default/groups/4e004dc2-11f0-4594-9c46-b39612e7ec34]."\n}' [ 800.770087] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e004dc2-11f0-4594-9c46-b39612e7ec34 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/4e004dc2-11f0-4594-9c46-b39612e7ec34 [ 800.770087] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 800.805763] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.805921] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.805992] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.806229] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.807898] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.808475] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.808624] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.808715] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.808914] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.809031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.809375] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.809534] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.809621] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.809803] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.809901] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.810074] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e004dc2-11f0-4594-9c46-b39612e7ec34 is going to be created. [ 800.829038] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/4e004dc2-11f0-4594-9c46-b39612e7ec34], does not exist path=[/infra/domains/default/groups/4e004dc2-11f0-4594-9c46-b39612e7ec34]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/4e004dc2-11f0-4594-9c46-b39612e7ec34 [ 800.829038] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e004dc2-11f0-4594-9c46-b39612e7ec34" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.830746] env[66502]: Traceback (most recent call last): [ 800.830746] env[66502]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 800.830746] env[66502]: return func(*args, **kwargs) [ 800.830746] env[66502]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 800.830746] env[66502]: res.raise_for_status() [ 800.830746] env[66502]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 800.830746] env[66502]: raise HTTPError(http_error_msg, response=self) [ 800.830746] env[66502]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/4e004dc2-11f0-4594-9c46-b39612e7ec34 [ 800.830746] env[66502]: During handling of the above exception, another exception occurred: [ 800.830746] env[66502]: Traceback (most recent call last): [ 800.830746] env[66502]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 800.830746] env[66502]: listener.cb(fileno) [ 800.830746] env[66502]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 800.830746] env[66502]: result = function(*args, **kwargs) [ 800.830746] env[66502]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 800.830746] env[66502]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 800.830746] env[66502]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 800.830746] env[66502]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 800.830746] env[66502]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 800.830746] env[66502]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 800.830746] env[66502]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 800.830746] env[66502]: res.raise_for_status() [ 800.830746] env[66502]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 800.830746] env[66502]: raise HTTPError(http_error_msg, response=self) [ 800.830746] env[66502]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/4e004dc2-11f0-4594-9c46-b39612e7ec34 [ 800.830746] env[66502]: Removing descriptor: 5 [ 800.965566] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.968325] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b96da033-21f1-44bb-a822-a4cb59139771 in Status: SUCCESS [ 800.968456] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.224149] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5326e5f8-d9c2-4aee-bce9-eb015451ed9b with status ACTIVE [ 801.225040] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.225040] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.225040] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.225040] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.225040] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.225504] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.225504] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.225504] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.225504] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.225854] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.225907] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.225996] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.226114] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.226274] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.226348] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.226433] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5326e5f8-d9c2-4aee-bce9-eb015451ed9b is going to be updated. [ 801.247593] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.247732] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.247822] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.248009] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.248140] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.248300] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5326e5f8-d9c2-4aee-bce9-eb015451ed9b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.470283] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.470478] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.470519] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.470722] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.470829] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.471090] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 is going to be updated. [ 801.505222] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.505386] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.505463] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.505776] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.505932] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.515856] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a in Status: SUCCESS [ 801.516431] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.517206] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 in Status: IN_PROGRESS for 2s [ 802.207075] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 in Status: SUCCESS [ 802.207075] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.207075] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.207075] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.207075] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.207075] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.207075] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.207075] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.207075] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.207075] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.207075] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4a35d19b-295e-4005-ae0f-c67844fbb164',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.208865] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.208865] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.209091] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.209091] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.209172] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.209288] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.209363] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.209449] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a35d19b-295e-4005-ae0f-c67844fbb164',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.501196] env[66502]: INFO networking_nsxv3.common.synchronization [req-59442d1e-53e5-440a-91e3-fce32f286e62 req-abecb72a-2612-42be-9755-9e72fa735ece tempest-ServersWithSpecificFlavorTestJSON-713469048 tempest-ServersWithSpecificFlavorTestJSON-713469048-project-member] Enqueued Resource ID: 7421254e-fac2-4232-97e1-1f7373688543 with Priority: HIGHEST for action security_group_members [ 802.501748] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7421254e-fac2-4232-97e1-1f7373688543 with Priority: HIGHEST for action security_group_members [ 802.502194] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-7421254e-fac2-4232-97e1-1f7373688543 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.502194] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.502463] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.502463] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.502556] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.502688] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.502778] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.502922] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.502973] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.505922] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7421254e-fac2-4232-97e1-1f7373688543',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.711709] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a35d19b-295e-4005-ae0f-c67844fbb164 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.711709] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.711895] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4a35d19b-295e-4005-ae0f-c67844fbb164',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.948272] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-583 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.948478] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-583" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.948602] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-583" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.948895] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-583" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.949174] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.949329] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.949445] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.949667] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.949819] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.950036] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 802.950147] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 802.950250] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 802.950350] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 802.950448] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 802.950547] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 802.950681] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 802.975378] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 802.975378] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 802.975378] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 802.975669] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-583" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.975843] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-bdffcd16-4022-417d-8b56-c4d5566b6439 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.976063] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-bdffcd16-4022-417d-8b56-c4d5566b6439" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.976220] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-bdffcd16-4022-417d-8b56-c4d5566b6439" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.976587] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-bdffcd16-4022-417d-8b56-c4d5566b6439" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.976799] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bdffcd16-4022-417d-8b56-c4d5566b6439',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.008448] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.008687] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.008687] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.008880] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.029458] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.029737] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.029858] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.029924] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.030150] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.030232] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.030321] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7421254e-fac2-4232-97e1-1f7373688543 is going to be updated. [ 803.060016] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.060016] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.060016] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.060016] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.060016] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.071828] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7421254e-fac2-4232-97e1-1f7373688543 in Status: IN_PROGRESS for 2s [ 803.215518] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4a35d19b-295e-4005-ae0f-c67844fbb164',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.479888] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.480225] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.480394] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.480761] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.480962] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.481179] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port bdffcd16-4022-417d-8b56-c4d5566b6439 not found, creating... [ 803.481514] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.481719] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.481888] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.482207] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.482340] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.482732] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.482919] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.483082] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.483372] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.483566] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.483735] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: bdffcd16-4022-417d-8b56-c4d5566b6439 is going to be created. [ 803.505856] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.506098] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.506199] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.506465] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.506682] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.506900] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-bdffcd16-4022-417d-8b56-c4d5566b6439" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.527933] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 in Status: SUCCESS [ 803.528149] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.528323] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.528930] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.528930] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.529138] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.529138] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.529870] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.529870] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.529870] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.529870] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.529870] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.529870] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.530185] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.530185] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.530185] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.530286] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.530417] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.530492] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.530578] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.530654] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.531491] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.531653] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.531801] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.531897] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.531960] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.532198] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.532284] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.532373] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.718211] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.718425] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.718558] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.719404] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.719404] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.719404] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 is going to be updated. [ 803.754692] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.754894] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.754946] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.755238] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.755417] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.769160] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 in Status: IN_PROGRESS for 2s [ 804.035408] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0bae9bdb-dcb4-4110-bcb0-1b0548a94738: rpc.has_security_group_logging(os_id): False [ 804.036483] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.056088] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.056230] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.057102] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.057102] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.057102] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.057102] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.057102] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.057102] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.057573] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.057573] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.057573] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.057573] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.057732] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.057769] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.057842] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.058151] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.058291] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.058375] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.058567] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.058673] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.058782] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 is going to be created. [ 804.120902] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.121125] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.121178] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.121382] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.121580] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.137426] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 in Status: IN_PROGRESS for 2s [ 804.294174] env[66502]: INFO networking_nsxv3.common.synchronization [req-59442d1e-53e5-440a-91e3-fce32f286e62 req-b0c78a83-d71a-42f7-adc8-e435194a182f service nova] Enqueued Resource ID: 7421254e-fac2-4232-97e1-1f7373688543 with Priority: HIGHEST for action security_group_rules [ 804.294481] env[66502]: INFO networking_nsxv3.common.synchronization [req-59442d1e-53e5-440a-91e3-fce32f286e62 req-b0c78a83-d71a-42f7-adc8-e435194a182f service nova] Enqueued Resource ID: 7421254e-fac2-4232-97e1-1f7373688543 with Priority: HIGHEST for action security_group_members [ 804.294481] env[66502]: INFO networking_nsxv3.common.synchronization [req-59442d1e-53e5-440a-91e3-fce32f286e62 req-b0c78a83-d71a-42f7-adc8-e435194a182f service nova] Enqueued Resource ID: bdffcd16-4022-417d-8b56-c4d5566b6439 with Priority: HIGHEST for action port [ 804.294917] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7421254e-fac2-4232-97e1-1f7373688543 with Priority: HIGHEST for action security_group_rules [ 804.295776] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7421254e-fac2-4232-97e1-1f7373688543 with Priority: HIGHEST for action security_group_members [ 804.295930] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bdffcd16-4022-417d-8b56-c4d5566b6439 with Priority: HIGHEST for action port [ 804.298865] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7421254e-fac2-4232-97e1-1f7373688543 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.298865] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.298865] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.298865] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.298865] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7421254e-fac2-4232-97e1-1f7373688543',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.298865] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-7421254e-fac2-4232-97e1-1f7373688543 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.298865] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.298865] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-bdffcd16-4022-417d-8b56-c4d5566b6439 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.300535] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bdffcd16-4022-417d-8b56-c4d5566b6439" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.300535] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bdffcd16-4022-417d-8b56-c4d5566b6439" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.300678] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bdffcd16-4022-417d-8b56-c4d5566b6439" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.300714] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bdffcd16-4022-417d-8b56-c4d5566b6439',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.539430] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.804014] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-7421254e-fac2-4232-97e1-1f7373688543 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.807487] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.807487] env[66502]: INFO networking_nsxv3.common.synchronization [req-b9320cb5-5c25-464a-83ce-78243fb25336 req-3249c7ea-fff7-4cfa-ac76-2d0f361daa65 tempest-ServersNegativeTestJSON-1444377316 tempest-ServersNegativeTestJSON-1444377316-project-member] Enqueued Resource ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a with Priority: HIGHEST for action security_group_members [ 804.807487] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bdffcd16-4022-417d-8b56-c4d5566b6439 with status ACTIVE [ 804.807487] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.807487] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.807487] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.807911] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.807911] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.808128] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.808271] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.808336] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.808572] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.808704] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.808984] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.809358] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.809358] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.809923] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.809923] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.809923] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bdffcd16-4022-417d-8b56-c4d5566b6439 is going to be updated. [ 804.811812] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a with Priority: HIGHEST for action security_group_members [ 804.812339] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ee12fee-49b0-4d1d-b52d-29888a355e8a taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.812519] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.813117] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.813117] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.813117] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.813331] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.813331] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.814797] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.814797] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.814797] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ee12fee-49b0-4d1d-b52d-29888a355e8a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.839325] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.839325] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.839325] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.839325] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.839325] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.839675] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bdffcd16-4022-417d-8b56-c4d5566b6439" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.042843] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.042992] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.043077] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.043295] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.043386] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.043504] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 is going to be updated. [ 805.077183] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.077335] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.077418] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.077641] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.077784] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.083593] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7421254e-fac2-4232-97e1-1f7373688543 in Status: SUCCESS [ 805.083794] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7421254e-fac2-4232-97e1-1f7373688543 deletion is rescheduled due to dependency. [ 805.083898] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.084070] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.084277] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.084456] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.084580] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.084663] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.084840] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.084926] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.085044] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7421254e-fac2-4232-97e1-1f7373688543',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.087269] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 in Status: IN_PROGRESS for 2s [ 805.317072] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ee12fee-49b0-4d1d-b52d-29888a355e8a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.587105] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7421254e-fac2-4232-97e1-1f7373688543',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.780644] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 in Status: SUCCESS [ 805.780859] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.781053] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.781326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.781609] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.781779] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.781848] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.782029] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.782126] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.782258] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a35d19b-295e-4005-ae0f-c67844fbb164',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.820446] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ee12fee-49b0-4d1d-b52d-29888a355e8a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.091941] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7421254e-fac2-4232-97e1-1f7373688543',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.156912] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 in Status: SUCCESS [ 806.157218] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.157491] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.157803] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.158077] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.285636] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4a35d19b-295e-4005-ae0f-c67844fbb164',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.324215] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.324609] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.324609] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.326406] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.326646] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.326733] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a is going to be updated. [ 806.377465] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.377465] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.377465] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.377465] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.377465] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.621478] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a in Status: IN_PROGRESS for 2s [ 806.621478] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.622094] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.622094] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.622094] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.622094] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.622094] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7421254e-fac2-4232-97e1-1f7373688543 is going to be updated. [ 806.661176] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.661333] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.661416] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.661652] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.663271] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.664534] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.664673] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.675317] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7421254e-fac2-4232-97e1-1f7373688543 in Status: IN_PROGRESS for 2s [ 806.788455] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4a35d19b-295e-4005-ae0f-c67844fbb164',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.099078] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 in Status: SUCCESS [ 807.099438] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.099585] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.099887] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.100114] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.100497] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.100497] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.100497] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.100731] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.100731] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.100731] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.291578] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.291578] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.291578] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.291578] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.291578] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.291578] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 is going to be updated. [ 807.333563] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.333919] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.333919] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.334407] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.334407] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.346639] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 in Status: IN_PROGRESS for 2s [ 807.511602] env[66502]: INFO networking_nsxv3.common.synchronization [req-56b58bc2-cdef-4d07-be08-21a459a17dd0 req-f70758c9-6c6a-4a09-805a-ed4cf38348b1 tempest-ServerActionsV293TestJSON-1501321181 tempest-ServerActionsV293TestJSON-1501321181-project-member] Enqueued Resource ID: 05164d98-30c1-459b-9f4c-ac294382c57e with Priority: HIGHEST for action security_group_members [ 807.511856] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05164d98-30c1-459b-9f4c-ac294382c57e with Priority: HIGHEST for action security_group_members [ 807.512434] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-05164d98-30c1-459b-9f4c-ac294382c57e taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.512573] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05164d98-30c1-459b-9f4c-ac294382c57e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.512633] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05164d98-30c1-459b-9f4c-ac294382c57e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.513097] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05164d98-30c1-459b-9f4c-ac294382c57e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.513166] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.513245] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.513318] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.513465] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.513543] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.513642] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05164d98-30c1-459b-9f4c-ac294382c57e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.604633] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.604633] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.604755] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.604913] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.605087] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.605189] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.605253] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.605399] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.607241] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.607367] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.607622] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.607713] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.607713] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.607878] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.608034] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.608132] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.608194] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.608337] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.608528] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.608528] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.608615] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.766886] env[66502]: INFO networking_nsxv3.common.synchronization [req-ecfc8c79-2e95-449d-afa7-e59082bdccba req-912b5b5d-103a-4ba9-9f87-faf52a678d67 tempest-ServerRescueTestJSONUnderV235-1015611946 tempest-ServerRescueTestJSONUnderV235-1015611946-project-member] Enqueued Resource ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 with Priority: HIGHEST for action security_group_members [ 807.766886] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 with Priority: HIGHEST for action security_group_members [ 807.766886] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a35d19b-295e-4005-ae0f-c67844fbb164 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.766886] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.932411] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-28 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.932711] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-28" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.932839] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-28" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.934020] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-28" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.934020] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.934020] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.934020] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.934247] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.934247] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.934658] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 807.934658] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 807.934658] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 807.934808] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 807.934847] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 807.934931] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 807.935064] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 807.954208] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 807.954208] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 807.954308] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 807.954436] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-28" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.954733] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-0052f641-2dd8-4428-acf9-f0d20241e6a3 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.954894] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-0052f641-2dd8-4428-acf9-f0d20241e6a3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.955011] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-0052f641-2dd8-4428-acf9-f0d20241e6a3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.955329] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-0052f641-2dd8-4428-acf9-f0d20241e6a3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.955460] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0052f641-2dd8-4428-acf9-f0d20241e6a3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.016168] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.017255] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.017255] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.017255] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.017255] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.017255] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.017255] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.017255] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.018012] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.018012] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.018012] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05164d98-30c1-459b-9f4c-ac294382c57e already deleted. [ 808.018012] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05164d98-30c1-459b-9f4c-ac294382c57e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.111401] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0bae9bdb-dcb4-4110-bcb0-1b0548a94738: rpc.has_security_group_logging(os_id): False [ 808.132306] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.132466] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.132655] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.132937] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.133044] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.133231] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.133326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.133392] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.133750] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.133750] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.133902] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.133956] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.133997] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.134145] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.134274] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.134411] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.134504] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.134565] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.134704] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.134778] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.134863] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 is going to be updated. [ 808.222347] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.222347] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.222347] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.222347] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.222625] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.238535] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 in Status: IN_PROGRESS for 2s [ 808.404868] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a in Status: SUCCESS [ 808.404868] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.457505] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.457723] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.459029] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.459029] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.459029] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.459029] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port 0052f641-2dd8-4428-acf9-f0d20241e6a3 not found, creating... [ 808.459029] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.459029] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.459029] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.459409] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.459409] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.459541] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.459690] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.459798] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.459995] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.460153] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.460353] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: 0052f641-2dd8-4428-acf9-f0d20241e6a3 is going to be created. [ 808.481540] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.481760] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.481864] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.482174] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.482397] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.482625] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-0052f641-2dd8-4428-acf9-f0d20241e6a3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.691038] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7421254e-fac2-4232-97e1-1f7373688543 in Status: SUCCESS [ 808.691387] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.691650] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.691929] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.692556] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.692556] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.692556] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.692749] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.692878] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.693280] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.693527] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7421254e-fac2-4232-97e1-1f7373688543',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.197699] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7421254e-fac2-4232-97e1-1f7373688543',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.213022] env[66502]: INFO networking_nsxv3.common.synchronization [req-56b58bc2-cdef-4d07-be08-21a459a17dd0 req-49f2cad4-bd64-484a-8272-c4fa4eaf84be service nova] Enqueued Resource ID: 05164d98-30c1-459b-9f4c-ac294382c57e with Priority: HIGHEST for action security_group_rules [ 809.213022] env[66502]: INFO networking_nsxv3.common.synchronization [req-56b58bc2-cdef-4d07-be08-21a459a17dd0 req-49f2cad4-bd64-484a-8272-c4fa4eaf84be service nova] Enqueued Resource ID: 05164d98-30c1-459b-9f4c-ac294382c57e with Priority: HIGHEST for action security_group_members [ 809.213022] env[66502]: INFO networking_nsxv3.common.synchronization [req-56b58bc2-cdef-4d07-be08-21a459a17dd0 req-49f2cad4-bd64-484a-8272-c4fa4eaf84be service nova] Enqueued Resource ID: 0052f641-2dd8-4428-acf9-f0d20241e6a3 with Priority: HIGHEST for action port [ 809.213442] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05164d98-30c1-459b-9f4c-ac294382c57e with Priority: HIGHEST for action security_group_rules [ 809.213749] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05164d98-30c1-459b-9f4c-ac294382c57e with Priority: HIGHEST for action security_group_members [ 809.214377] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0052f641-2dd8-4428-acf9-f0d20241e6a3 with Priority: HIGHEST for action port [ 809.217027] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05164d98-30c1-459b-9f4c-ac294382c57e taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.217027] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05164d98-30c1-459b-9f4c-ac294382c57e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.217027] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05164d98-30c1-459b-9f4c-ac294382c57e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.217027] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05164d98-30c1-459b-9f4c-ac294382c57e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.217027] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05164d98-30c1-459b-9f4c-ac294382c57e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.217541] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-05164d98-30c1-459b-9f4c-ac294382c57e taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.217771] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05164d98-30c1-459b-9f4c-ac294382c57e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.217949] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05164d98-30c1-459b-9f4c-ac294382c57e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.218288] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05164d98-30c1-459b-9f4c-ac294382c57e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.218824] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.219076] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.219240] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.219754] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.220295] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.220508] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05164d98-30c1-459b-9f4c-ac294382c57e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.222270] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-0052f641-2dd8-4428-acf9-f0d20241e6a3 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.222270] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0052f641-2dd8-4428-acf9-f0d20241e6a3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.222270] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0052f641-2dd8-4428-acf9-f0d20241e6a3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.222270] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0052f641-2dd8-4428-acf9-f0d20241e6a3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.222270] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0052f641-2dd8-4428-acf9-f0d20241e6a3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.362410] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 in Status: SUCCESS [ 809.362757] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.362914] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.363230] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.363507] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.363675] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.363763] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.364061] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.366880] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.366984] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.367182] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4a35d19b-295e-4005-ae0f-c67844fbb164 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.367264] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.367338] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.367489] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.367643] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.367822] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.367822] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.367969] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.368023] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.368103] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.368360] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4a35d19b-295e-4005-ae0f-c67844fbb164',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.369876] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.371721] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.371721] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.371721] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.371721] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.371721] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.371721] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.371721] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4a35d19b-295e-4005-ae0f-c67844fbb164',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.699605] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7421254e-fac2-4232-97e1-1f7373688543: rpc.has_security_group_logging(os_id): False [ 809.719977] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.720195] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.720308] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.720509] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.720605] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.720840] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.720939] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.721011] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.721218] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.721331] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.721424] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7421254e-fac2-4232-97e1-1f7373688543 is going to be updated. [ 809.726276] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('05164d98-30c1-459b-9f4c-ac294382c57e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.727774] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-05164d98-30c1-459b-9f4c-ac294382c57e taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.727886] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05164d98-30c1-459b-9f4c-ac294382c57e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.728104] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0052f641-2dd8-4428-acf9-f0d20241e6a3 with status ACTIVE [ 809.728267] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.728376] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.728454] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.728637] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.728719] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.728892] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.729043] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.730556] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.731197] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.731823] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.732556] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.732727] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.732865] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.733116] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.733248] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.733380] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0052f641-2dd8-4428-acf9-f0d20241e6a3 is going to be updated. [ 809.755462] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.755636] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.755779] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.755907] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.756079] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.756221] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0052f641-2dd8-4428-acf9-f0d20241e6a3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.784811] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.784986] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.785036] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.785247] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.785397] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.796484] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7421254e-fac2-4232-97e1-1f7373688543 in Status: IN_PROGRESS for 2s [ 809.840018] env[66502]: INFO networking_nsxv3.common.synchronization [req-e26472a9-f34b-4625-ad8a-5fd85bedc40b req-20ca4bde-2e22-4568-9240-66ba7811d72c tempest-InstanceActionsV221TestJSON-275275078 tempest-InstanceActionsV221TestJSON-275275078-project-member] Enqueued Resource ID: fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5 with Priority: HIGHEST for action security_group_members [ 809.844049] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5 with Priority: HIGHEST for action security_group_members [ 809.844049] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.844049] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.844049] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.844531] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.844531] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.844634] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.844634] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.845058] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.845058] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.845058] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.870874] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4a35d19b-295e-4005-ae0f-c67844fbb164: rpc.has_security_group_logging(os_id): False [ 809.881979] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.882327] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.882327] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.882624] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.895105] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.895187] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.916659] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.916968] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.917114] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.917178] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.917420] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.917471] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.917553] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 is going to be updated. [ 809.918543] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.918779] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.918879] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.919293] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.919371] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.919418] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.919558] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.919640] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.920217] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.920503] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.920575] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.920887] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.920974] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.921365] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.921563] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.921629] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.921793] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.921859] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.921986] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 is going to be updated. [ 809.950495] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.950642] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.950738] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.950967] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.951131] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.960289] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 in Status: IN_PROGRESS for 2s [ 809.990383] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.990383] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.990383] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.990383] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.990383] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.014605] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 in Status: IN_PROGRESS for 2s [ 810.235736] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('05164d98-30c1-459b-9f4c-ac294382c57e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.260954] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 in Status: SUCCESS [ 810.260954] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.260954] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.261573] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.261748] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.349056] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.351264] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.351264] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.351264] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.351264] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.351264] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.351264] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.351264] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.351264] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.351264] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.351727] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5 already deleted. [ 810.351727] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.387773] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-877 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.388037] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-877" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.388180] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-877" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.388580] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-877" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.388860] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.389078] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.389225] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.389370] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.389510] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.389724] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 810.390056] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 810.390313] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 810.390440] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 810.390564] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 810.390668] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 810.390992] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 810.425705] env[66502]: INFO networking_nsxv3.common.synchronization [None req-aff4d141-4ed7-47c9-9f8e-d5de2b865d77 None None] Enqueued Resource ID: 81d02787-bf48-4b95-b300-25a9c50f071a with Priority: HIGHEST for action port [ 810.426577] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 81d02787-bf48-4b95-b300-25a9c50f071a with Priority: HIGHEST for action port [ 810.426965] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-81d02787-bf48-4b95-b300-25a9c50f071a taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.427155] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-81d02787-bf48-4b95-b300-25a9c50f071a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.427155] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-81d02787-bf48-4b95-b300-25a9c50f071a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.427575] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-81d02787-bf48-4b95-b300-25a9c50f071a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.427706] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('81d02787-bf48-4b95-b300-25a9c50f071a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.431549] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 810.431725] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.041 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 810.431903] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 810.432143] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-877" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.432460] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-40212014-3ac1-480a-829d-e5a32d6902cd taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.432626] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-40212014-3ac1-480a-829d-e5a32d6902cd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.432748] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-40212014-3ac1-480a-829d-e5a32d6902cd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.433088] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-40212014-3ac1-480a-829d-e5a32d6902cd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.433228] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40212014-3ac1-480a-829d-e5a32d6902cd',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.738961] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.739413] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.739413] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.739413] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.739614] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.739614] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05164d98-30c1-459b-9f4c-ac294382c57e is going to be created. [ 810.768708] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.768866] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.768920] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.769171] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.769341] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.769441] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.769502] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.769666] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.769755] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.769843] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.769931] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.771605] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.771720] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.771793] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.773506] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.774020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.786666] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05164d98-30c1-459b-9f4c-ac294382c57e in Status: UNINITIALIZED for 2s [ 810.930245] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 81d02787-bf48-4b95-b300-25a9c50f071a [ 810.930611] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.931237] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.931447] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.931997] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.932858] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.932927] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:81d02787-bf48-4b95-b300-25a9c50f071a already deleted. [ 810.933091] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-81d02787-bf48-4b95-b300-25a9c50f071a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.937056] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.937259] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.937374] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.937646] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.937779] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.937916] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 40212014-3ac1-480a-829d-e5a32d6902cd not found, creating... [ 810.938231] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.938381] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.938496] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.938727] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.938861] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.939173] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.939317] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.939422] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.939620] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.939740] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.939865] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 40212014-3ac1-480a-829d-e5a32d6902cd is going to be created. [ 810.970614] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.970800] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.970893] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.971193] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.971422] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.972033] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-40212014-3ac1-480a-829d-e5a32d6902cd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.277140] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.277347] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.277440] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.277714] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.278043] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.278043] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.278222] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.278263] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.278333] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.278421] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.278565] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.278654] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.278715] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.278854] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.278989] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.279089] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.279150] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.279285] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.279361] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.279441] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.279530] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.718353] env[66502]: INFO networking_nsxv3.common.synchronization [req-e26472a9-f34b-4625-ad8a-5fd85bedc40b req-a384751f-f311-4cf2-8b9b-3c40116ac4d8 service nova] Enqueued Resource ID: fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5 with Priority: HIGHEST for action security_group_rules [ 811.718604] env[66502]: INFO networking_nsxv3.common.synchronization [req-e26472a9-f34b-4625-ad8a-5fd85bedc40b req-a384751f-f311-4cf2-8b9b-3c40116ac4d8 service nova] Enqueued Resource ID: fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5 with Priority: HIGHEST for action security_group_members [ 811.718726] env[66502]: INFO networking_nsxv3.common.synchronization [req-e26472a9-f34b-4625-ad8a-5fd85bedc40b req-a384751f-f311-4cf2-8b9b-3c40116ac4d8 service nova] Enqueued Resource ID: 40212014-3ac1-480a-829d-e5a32d6902cd with Priority: HIGHEST for action port [ 811.719813] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5 with Priority: HIGHEST for action security_group_rules [ 811.719988] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5 with Priority: HIGHEST for action security_group_members [ 811.721043] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 40212014-3ac1-480a-829d-e5a32d6902cd with Priority: HIGHEST for action port [ 811.721043] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.721420] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.721420] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.721491] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.721532] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.722535] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.722698] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.722741] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.722915] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.723885] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.724016] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.724109] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.725174] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.725174] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.725174] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.728685] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-40212014-3ac1-480a-829d-e5a32d6902cd taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.728685] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-40212014-3ac1-480a-829d-e5a32d6902cd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.728685] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-40212014-3ac1-480a-829d-e5a32d6902cd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.728685] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-40212014-3ac1-480a-829d-e5a32d6902cd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.728685] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('40212014-3ac1-480a-829d-e5a32d6902cd',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.783130] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0bae9bdb-dcb4-4110-bcb0-1b0548a94738: rpc.has_security_group_logging(os_id): False [ 811.807969] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.807969] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.807969] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.807969] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.807969] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.807969] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.807969] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.807969] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.807969] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.807969] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.807969] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.807969] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.807969] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.811784] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.811784] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.811784] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.811784] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.811784] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.811784] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.811784] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.811784] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 is going to be updated. [ 811.814320] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7421254e-fac2-4232-97e1-1f7373688543 in Status: SUCCESS [ 811.814320] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.884129] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.884129] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.884129] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.884461] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.884504] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.910435] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 in Status: IN_PROGRESS for 2s [ 811.978151] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 in Status: SUCCESS [ 811.978151] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 deletion is rescheduled due to dependency. [ 811.978151] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.030934] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 in Status: SUCCESS [ 812.031235] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.031397] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.031647] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.031754] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4a35d19b-295e-4005-ae0f-c67844fbb164',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.158908] env[66502]: INFO networking_nsxv3.common.synchronization [None req-e9b1c33d-d29d-4097-9161-b891c219b826 tempest-ServerActionsTestOtherB-501490242 tempest-ServerActionsTestOtherB-501490242-project-member] Enqueued Resource ID: 670eb61a-b688-45b2-9400-64232c7b8af0 with Priority: HIGHEST for action security_group_rules [ 812.159397] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 670eb61a-b688-45b2-9400-64232c7b8af0 with Priority: HIGHEST for action security_group_rules [ 812.159680] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-670eb61a-b688-45b2-9400-64232c7b8af0 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.159834] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.159904] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.160485] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.160485] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('670eb61a-b688-45b2-9400-64232c7b8af0',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.233031] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.233031] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.233031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.233031] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 40212014-3ac1-480a-829d-e5a32d6902cd with status ACTIVE [ 812.233031] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.233031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.233031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.233031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.233031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.233567] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.233567] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.233567] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.233567] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.233567] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.233828] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.234817] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.234817] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.234817] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.234817] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.234817] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 40212014-3ac1-480a-829d-e5a32d6902cd is going to be updated. [ 812.261851] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.261851] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.261851] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.261851] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.261851] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.261851] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-40212014-3ac1-480a-829d-e5a32d6902cd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.270924] env[66502]: INFO networking_nsxv3.common.synchronization [None req-b3149160-2995-40d5-a1af-26b061ec4bee tempest-ServerActionsTestOtherB-501490242 tempest-ServerActionsTestOtherB-501490242-project-member] Enqueued Resource ID: 670eb61a-b688-45b2-9400-64232c7b8af0 with Priority: HIGHEST for action security_group_rules [ 812.273025] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 670eb61a-b688-45b2-9400-64232c7b8af0 with Priority: HIGHEST for action security_group_rules [ 812.273548] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-670eb61a-b688-45b2-9400-64232c7b8af0 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.273712] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.561231] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.562463] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.562463] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.562463] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.562463] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.562463] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4a35d19b-295e-4005-ae0f-c67844fbb164 is going to be deleted. [ 812.625651] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.625975] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.626027] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.626415] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.626557] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.627107] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4a35d19b-295e-4005-ae0f-c67844fbb164" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.690571] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.690771] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.690919] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.691234] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.691404] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.691590] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 670eb61a-b688-45b2-9400-64232c7b8af0 already deleted. [ 812.691790] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.692024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.693722] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.693836] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('670eb61a-b688-45b2-9400-64232c7b8af0',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.735343] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.800515] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05164d98-30c1-459b-9f4c-ac294382c57e in Status: SUCCESS [ 812.801226] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05164d98-30c1-459b-9f4c-ac294382c57e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.801226] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05164d98-30c1-459b-9f4c-ac294382c57e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.801226] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05164d98-30c1-459b-9f4c-ac294382c57e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.801517] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.801517] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.801665] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.801750] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.801810] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.801888] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05164d98-30c1-459b-9f4c-ac294382c57e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.802023] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('05164d98-30c1-459b-9f4c-ac294382c57e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.222045] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.222252] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.222337] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.222567] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.222661] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.222760] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 670eb61a-b688-45b2-9400-64232c7b8af0 already deleted. [ 813.222846] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.239559] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.239706] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.239782] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.240014] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.240115] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.240216] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5 is going to be created. [ 813.270722] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.270915] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.271022] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.271301] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.271527] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.277301] env[66502]: INFO networking_nsxv3.common.synchronization [None req-2eef96a4-5752-4b49-897e-33cbcf8a33d5 None None] Enqueued Resource ID: 01d4995f-59de-4adb-b22c-a582e8401b00 with Priority: HIGHEST for action port [ 813.278022] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01d4995f-59de-4adb-b22c-a582e8401b00 with Priority: HIGHEST for action port [ 813.279071] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-01d4995f-59de-4adb-b22c-a582e8401b00 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.279071] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01d4995f-59de-4adb-b22c-a582e8401b00" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.279071] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01d4995f-59de-4adb-b22c-a582e8401b00" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.279447] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01d4995f-59de-4adb-b22c-a582e8401b00" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.279447] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01d4995f-59de-4adb-b22c-a582e8401b00',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.284246] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5 in Status: UNINITIALIZED for 2s [ 813.307682] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('05164d98-30c1-459b-9f4c-ac294382c57e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.784106] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 01d4995f-59de-4adb-b22c-a582e8401b00 [ 813.784477] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.784672] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.784788] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.786446] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.786446] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.786446] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:01d4995f-59de-4adb-b22c-a582e8401b00 already deleted. [ 813.786446] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01d4995f-59de-4adb-b22c-a582e8401b00" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.812166] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 05164d98-30c1-459b-9f4c-ac294382c57e: rpc.has_security_group_logging(os_id): False [ 813.834339] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.834755] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.834873] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.835376] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.835376] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.835761] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.836619] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.836803] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.837207] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.837432] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.837540] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05164d98-30c1-459b-9f4c-ac294382c57e is going to be created. [ 813.929623] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.929880] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.929880] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.930126] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.930323] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.940761] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 in Status: SUCCESS [ 813.941086] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.944698] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05164d98-30c1-459b-9f4c-ac294382c57e in Status: IN_PROGRESS for 2s [ 814.990722] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.991033] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.991033] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.991196] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.991305] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.133656] env[66502]: INFO networking_nsxv3.common.synchronization [req-e03fb883-e621-4551-baa2-212404386eda req-1f350529-d21d-4e91-b89c-8b65bdde1e8e tempest-ImagesOneServerNegativeTestJSON-1621881971 tempest-ImagesOneServerNegativeTestJSON-1621881971-project-member] Enqueued Resource ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 with Priority: HIGHEST for action security_group_members [ 815.134305] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 with Priority: HIGHEST for action security_group_members [ 815.134694] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.134879] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.134879] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.134973] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.136038] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.136154] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.136154] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.136347] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.136441] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.137535] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ddb3b9a8-c63d-4123-aa7f-cbf2b5279231',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.298579] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5 in Status: SUCCESS [ 815.300821] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.300821] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.300821] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.300821] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.300821] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.300821] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.300821] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.300821] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.300821] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.300821] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.373271] env[66502]: INFO networking_nsxv3.common.synchronization [req-caff1991-ee85-4154-b616-22ce97ffcb47 req-05932491-857d-4ae1-83eb-d5d1d864a60c tempest-ServersTestMultiNic-1258705533 tempest-ServersTestMultiNic-1258705533-project-member] Enqueued Resource ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 with Priority: HIGHEST for action security_group_members [ 815.373271] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 with Priority: HIGHEST for action security_group_members [ 815.374122] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.374522] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.374736] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.375123] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.375425] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.375687] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.375960] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.376283] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.376497] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.377951] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.494973] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.503937] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-885 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.504141] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-885" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.504271] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-885" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.504918] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-885" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.505284] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.505502] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.505656] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.505951] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.506180] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.506538] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 815.506722] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 815.506908] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 815.507070] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 815.507214] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 815.507347] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 815.507508] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 815.529107] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 815.529282] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 815.529412] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 815.529589] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-885" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.530107] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-0f95cde5-f8a5-4870-9a98-56ca046b5849 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.530107] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-0f95cde5-f8a5-4870-9a98-56ca046b5849" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.530212] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-0f95cde5-f8a5-4870-9a98-56ca046b5849" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.530462] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-0f95cde5-f8a5-4870-9a98-56ca046b5849" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.530626] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f95cde5-f8a5-4870-9a98-56ca046b5849',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.640654] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.640880] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.640880] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.641157] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.664578] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.664850] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.664970] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.665050] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.665282] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.665368] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.665461] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 is going to be updated. [ 815.692426] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.692426] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.692426] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.692848] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.692848] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.704212] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 in Status: IN_PROGRESS for 2s [ 815.719124] env[66502]: INFO networking_nsxv3.common.synchronization [req-caff1991-ee85-4154-b616-22ce97ffcb47 req-d8beb37e-4e87-44c0-b1a3-8c65469d0b9c tempest-ServersTestMultiNic-1258705533 tempest-ServersTestMultiNic-1258705533-project-member] Enqueued Resource ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 with Priority: HIGHEST for action security_group_members [ 815.720056] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 with Priority: HIGHEST for action security_group_members [ 815.720056] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.720302] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.803355] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.803610] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.803610] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.803901] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.804113] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.804242] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.804302] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.804470] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.804561] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.804669] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.804827] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.804969] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.805047] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.805221] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.805366] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.805460] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.805522] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.805683] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.805766] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.805860] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.805973] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.879334] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.964395] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 05164d98-30c1-459b-9f4c-ac294382c57e in Status: SUCCESS [ 815.964712] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05164d98-30c1-459b-9f4c-ac294382c57e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.997367] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.033483] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.033810] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.033951] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.034248] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.034381] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.034532] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port 0f95cde5-f8a5-4870-9a98-56ca046b5849 not found, creating... [ 816.034812] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.035045] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.035178] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.035416] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.035547] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.035934] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.036175] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.036312] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.036539] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.036668] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.036809] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: 0f95cde5-f8a5-4870-9a98-56ca046b5849 is going to be created. [ 816.059899] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.060234] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.060299] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.060534] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.060753] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.060977] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-0f95cde5-f8a5-4870-9a98-56ca046b5849" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.073602] env[66502]: INFO networking_nsxv3.common.synchronization [req-caff1991-ee85-4154-b616-22ce97ffcb47 req-662cd988-07c1-4763-8489-8c0ad5e6079f tempest-ServersTestMultiNic-1258705533 tempest-ServersTestMultiNic-1258705533-project-member] Enqueued Resource ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 with Priority: HIGHEST for action security_group_members [ 816.074163] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 with Priority: HIGHEST for action security_group_members [ 816.074689] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.074841] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.308586] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5: rpc.has_security_group_logging(os_id): False [ 816.326380] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.326534] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.326594] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.326865] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.326982] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.327179] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.327276] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.327338] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.327490] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.327560] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.327745] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.327841] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.327898] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.328049] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.328118] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.328309] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.328398] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.328454] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.328590] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.328693] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.328735] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5 is going to be created. [ 816.383227] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.385255] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.385418] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.385486] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.385834] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.385974] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.398430] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5 in Status: IN_PROGRESS for 2s [ 816.440403] env[66502]: INFO networking_nsxv3.common.synchronization [req-2ca747e1-1e43-49d9-8309-c9b83b751bfd req-a550046c-764c-4974-a164-0900a9518be2 tempest-DeleteServersTestJSON-51385704 tempest-DeleteServersTestJSON-51385704-project-member] Enqueued Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_members [ 816.441080] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_members [ 816.441395] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-704e5eab-aa44-4493-8c9a-0b24250e7bea taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.441514] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.441580] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.441856] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.441931] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.442422] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.442422] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.442422] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.442422] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.442422] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.500454] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 816.500585] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 816.772099] env[66502]: INFO networking_nsxv3.common.synchronization [req-e03fb883-e621-4551-baa2-212404386eda req-503bbdd4-4bce-4073-8c93-a1eed1ec6ff6 service nova] Enqueued Resource ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 with Priority: HIGHEST for action security_group_rules [ 816.772099] env[66502]: INFO networking_nsxv3.common.synchronization [req-e03fb883-e621-4551-baa2-212404386eda req-503bbdd4-4bce-4073-8c93-a1eed1ec6ff6 service nova] Enqueued Resource ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 with Priority: HIGHEST for action security_group_members [ 816.772099] env[66502]: INFO networking_nsxv3.common.synchronization [req-e03fb883-e621-4551-baa2-212404386eda req-503bbdd4-4bce-4073-8c93-a1eed1ec6ff6 service nova] Enqueued Resource ID: 0f95cde5-f8a5-4870-9a98-56ca046b5849 with Priority: HIGHEST for action port [ 816.772626] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 with Priority: HIGHEST for action security_group_rules [ 816.772626] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 with Priority: HIGHEST for action security_group_members [ 816.772707] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f95cde5-f8a5-4870-9a98-56ca046b5849 with Priority: HIGHEST for action port [ 816.773290] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.773290] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.773290] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.773541] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.773592] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ddb3b9a8-c63d-4123-aa7f-cbf2b5279231',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.774476] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.774574] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.774777] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f95cde5-f8a5-4870-9a98-56ca046b5849 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.774909] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f95cde5-f8a5-4870-9a98-56ca046b5849" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.774972] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f95cde5-f8a5-4870-9a98-56ca046b5849" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.775194] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f95cde5-f8a5-4870-9a98-56ca046b5849" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.775282] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f95cde5-f8a5-4870-9a98-56ca046b5849',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.884958] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.885163] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.885320] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.885427] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.885542] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.885711] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 is going to be updated. [ 816.922851] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.923068] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.923112] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.926024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.926024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.937581] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 in Status: IN_PROGRESS for 2s [ 816.944524] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.944524] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.944524] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.944761] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.981717] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.981717] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.981905] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.981905] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.982109] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.982195] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.982289] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea is going to be updated. [ 817.024845] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.025201] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.025201] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.025201] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.025326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.037937] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: IN_PROGRESS for 2s [ 817.276992] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.277197] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.278258] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0f95cde5-f8a5-4870-9a98-56ca046b5849 with status ACTIVE [ 817.278258] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.278258] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.278258] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.278489] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.278489] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.278681] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.278784] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.278845] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.279596] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.279596] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.279596] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.279596] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.279596] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.279596] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.279862] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.279862] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0f95cde5-f8a5-4870-9a98-56ca046b5849 is going to be updated. [ 817.338243] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.338433] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.338433] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.338675] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.339057] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.339242] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f95cde5-f8a5-4870-9a98-56ca046b5849" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.479861] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.480029] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.480090] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.480338] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.492852] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 817.493391] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.494581] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 817.530161] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.530161] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.530321] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.530422] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.539163] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.539810] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 817.539898] env[66502]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66502) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 817.539985] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 817.581522] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.581656] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.581775] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.582029] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.582818] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.583175] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 817.657264] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.657264] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.658155] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.658155] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.658155] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.660450] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 817.715479] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 in Status: SUCCESS [ 817.715671] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 deletion is rescheduled due to dependency. [ 817.715858] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.716042] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.716259] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.716441] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.716555] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.716618] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.717231] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.717231] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.717231] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ddb3b9a8-c63d-4123-aa7f-cbf2b5279231',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.731638] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.732161] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.732409] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.732799] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.733074] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.733503] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:31. [ 817.733503] env[66502]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'ee2e9577-19ff-440d-9bd8-24dbaf88ea24', '6215e376-fd44-487b-9cf4-9b65dd953e4e', '9d226a97-2d69-4706-b98b-565700008c6f', '2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49', 'ba4a0494-e0b7-44c9-b74f-00469639644c', '25ed9582-5ba1-4260-bd41-77518f4c6d14', 'b1dbab98-9c58-424b-aadb-07860f808828', 'bb24e830-31ca-4b75-ba92-3835430fbf29', 'c7d21481-83aa-4bac-bea4-1030ed0a857b', 'ddb3b9a8-c63d-4123-aa7f-cbf2b5279231', '8ab1d50c-f5a6-4aaf-829b-d0cfdf164722', 'd777850f-4bcd-420d-ab88-295134770a5c', 'b96da033-21f1-44bb-a822-a4cb59139771', '32ff0aad-cfa5-4379-8483-9c7077a46f10', '704e5eab-aa44-4493-8c9a-0b24250e7bea', 'aba51398-48dc-4f5e-b3cf-1da4130d58fb', '10c7f564-e48d-436c-95ae-202237b0b833', '9f4a2c28-0514-4b56-8107-7969d0d9335c', '96893623-1913-4658-8960-6e93015a062e', '75e42630-d365-4bb0-89c0-55b0baee0268', '05164d98-30c1-459b-9f4c-ac294382c57e', '0bae9bdb-dcb4-4110-bcb0-1b0548a94738', '881e7189-5d27-4efb-b9a3-71f2b26c3add', 'fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5', '7421254e-fac2-4232-97e1-1f7373688543', 'eeb100e3-e5a7-4d38-a030-42278dbe1366', '67c97dc5-9d08-4219-aa00-0b83a223ae57', '6de9830d-7ae4-42f4-8f89-7bd0093a3ef2', 'b4dfff3d-ef74-48f2-8955-b975cccf84d9', '9ee12fee-49b0-4d1d-b52d-29888a355e8a', 'e12852c1-7dc2-4ed2-bd34-e396f9f9256d'} {{(pid=66502) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 817.735249] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 817.755380] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.755568] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.755626] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.755924] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.755965] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.756120] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 817.756160] env[66502]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66502) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 817.756236] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 817.834066] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.834066] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.834066] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.834066] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.834649] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.834855] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 817.835294] env[66502]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66502) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 817.835294] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 817.835865] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 817.836181] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/31 resources of Type:Security Group Rules [ 817.836181] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 with Priority: HIGH for action security_group_rules [ 817.836298] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6215e376-fd44-487b-9cf4-9b65dd953e4e with Priority: HIGH for action security_group_rules [ 817.836337] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGH for action security_group_rules [ 817.836435] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49 with Priority: HIGH for action security_group_rules [ 817.836482] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ba4a0494-e0b7-44c9-b74f-00469639644c with Priority: HIGH for action security_group_rules [ 817.836515] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 25ed9582-5ba1-4260-bd41-77518f4c6d14 with Priority: HIGH for action security_group_rules [ 817.836579] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b1dbab98-9c58-424b-aadb-07860f808828 with Priority: HIGH for action security_group_rules [ 817.836642] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bb24e830-31ca-4b75-ba92-3835430fbf29 with Priority: HIGH for action security_group_rules [ 817.836791] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c7d21481-83aa-4bac-bea4-1030ed0a857b with Priority: HIGH for action security_group_rules [ 817.836791] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 with Priority: HIGH for action security_group_rules [ 817.836866] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 with Priority: HIGH for action security_group_rules [ 817.836924] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d777850f-4bcd-420d-ab88-295134770a5c with Priority: HIGH for action security_group_rules [ 817.837034] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b96da033-21f1-44bb-a822-a4cb59139771 with Priority: HIGH for action security_group_rules [ 817.837091] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 32ff0aad-cfa5-4379-8483-9c7077a46f10 with Priority: HIGH for action security_group_rules [ 817.837137] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGH for action security_group_rules [ 817.837202] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGH for action security_group_rules [ 817.837277] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 10c7f564-e48d-436c-95ae-202237b0b833 with Priority: HIGH for action security_group_rules [ 817.837365] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9f4a2c28-0514-4b56-8107-7969d0d9335c with Priority: HIGH for action security_group_rules [ 817.837399] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 96893623-1913-4658-8960-6e93015a062e with Priority: HIGH for action security_group_rules [ 817.837499] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 75e42630-d365-4bb0-89c0-55b0baee0268 with Priority: HIGH for action security_group_rules [ 817.837560] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.219477] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ddb3b9a8-c63d-4123-aa7f-cbf2b5279231',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.411527] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5 in Status: SUCCESS [ 818.413111] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.721347] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ddb3b9a8-c63d-4123-aa7f-cbf2b5279231',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.952529] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 in Status: SUCCESS [ 818.952529] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.952529] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.952529] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.952529] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.952923] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.952923] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.952923] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.952923] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.953087] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.049955] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: SUCCESS [ 819.050168] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea deletion is rescheduled due to dependency. [ 819.050339] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.224511] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.224811] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.224811] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.224917] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.224990] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.225105] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 is going to be updated. [ 819.258787] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.258787] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.258787] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.259037] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.259141] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.271146] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 in Status: IN_PROGRESS for 2s [ 819.324456] env[66502]: INFO networking_nsxv3.common.synchronization [None req-0aef5b75-dafe-43a8-9c92-2b220c385c38 tempest-ServerActionsTestJSON-2133613622 tempest-ServerActionsTestJSON-2133613622-project-member] Enqueued Resource ID: b10a43dc-2d28-4687-a424-05a1ebdfa3c3 with Priority: HIGHEST for action security_group_rules [ 819.325205] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b10a43dc-2d28-4687-a424-05a1ebdfa3c3 with Priority: HIGHEST for action security_group_rules [ 819.325409] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 with Priority: HIGH for action security_group_rules [ 819.325537] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGH for action security_group_rules [ 819.325641] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b1dbab98-9c58-424b-aadb-07860f808828 with Priority: HIGH for action security_group_rules [ 819.325753] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGH for action security_group_rules [ 819.325865] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75e42630-d365-4bb0-89c0-55b0baee0268 with Priority: HIGH for action security_group_rules [ 819.325969] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96893623-1913-4658-8960-6e93015a062e with Priority: HIGH for action security_group_rules [ 819.326133] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f4a2c28-0514-4b56-8107-7969d0d9335c with Priority: HIGH for action security_group_rules [ 819.326822] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 10c7f564-e48d-436c-95ae-202237b0b833 with Priority: HIGH for action security_group_rules [ 819.326965] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32ff0aad-cfa5-4379-8483-9c7077a46f10 with Priority: HIGH for action security_group_rules [ 819.327441] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGH for action security_group_rules [ 819.327441] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b96da033-21f1-44bb-a822-a4cb59139771 with Priority: HIGH for action security_group_rules [ 819.327441] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d777850f-4bcd-420d-ab88-295134770a5c with Priority: HIGH for action security_group_rules [ 819.327730] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 with Priority: HIGH for action security_group_rules [ 819.327730] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 with Priority: HIGH for action security_group_rules [ 819.327730] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7d21481-83aa-4bac-bea4-1030ed0a857b with Priority: HIGH for action security_group_rules [ 819.327943] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25ed9582-5ba1-4260-bd41-77518f4c6d14 with Priority: HIGH for action security_group_rules [ 819.327943] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb24e830-31ca-4b75-ba92-3835430fbf29 with Priority: HIGH for action security_group_rules [ 819.328047] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba4a0494-e0b7-44c9-b74f-00469639644c with Priority: HIGH for action security_group_rules [ 819.328095] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6215e376-fd44-487b-9cf4-9b65dd953e4e with Priority: HIGH for action security_group_rules [ 819.329374] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49 with Priority: HIGH for action security_group_rules [ 819.329781] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b10a43dc-2d28-4687-a424-05a1ebdfa3c3 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.329908] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b10a43dc-2d28-4687-a424-05a1ebdfa3c3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.329949] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b10a43dc-2d28-4687-a424-05a1ebdfa3c3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.330224] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b10a43dc-2d28-4687-a424-05a1ebdfa3c3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.330390] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b10a43dc-2d28-4687-a424-05a1ebdfa3c3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.332250] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee2e9577-19ff-440d-9bd8-24dbaf88ea24 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.332250] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.332449] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.334235] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.334235] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.334822] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.334949] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.335079] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.336235] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.336235] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.336681] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b1dbab98-9c58-424b-aadb-07860f808828 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.336681] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b1dbab98-9c58-424b-aadb-07860f808828" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.336852] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b1dbab98-9c58-424b-aadb-07860f808828" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.337061] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b1dbab98-9c58-424b-aadb-07860f808828" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.337149] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b1dbab98-9c58-424b-aadb-07860f808828',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.338837] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-704e5eab-aa44-4493-8c9a-0b24250e7bea taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.338958] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.341606] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.341606] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.341606] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.341606] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75e42630-d365-4bb0-89c0-55b0baee0268 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.341606] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.341606] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.341606] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.341606] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75e42630-d365-4bb0-89c0-55b0baee0268',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.342897] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-96893623-1913-4658-8960-6e93015a062e taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.343103] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-96893623-1913-4658-8960-6e93015a062e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.343103] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-96893623-1913-4658-8960-6e93015a062e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.343267] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-96893623-1913-4658-8960-6e93015a062e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.343336] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('96893623-1913-4658-8960-6e93015a062e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.344652] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f4a2c28-0514-4b56-8107-7969d0d9335c taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.344785] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f4a2c28-0514-4b56-8107-7969d0d9335c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.344856] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f4a2c28-0514-4b56-8107-7969d0d9335c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.345115] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f4a2c28-0514-4b56-8107-7969d0d9335c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.345198] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f4a2c28-0514-4b56-8107-7969d0d9335c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.346390] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-10c7f564-e48d-436c-95ae-202237b0b833 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.346514] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-10c7f564-e48d-436c-95ae-202237b0b833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.346597] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-10c7f564-e48d-436c-95ae-202237b0b833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.346904] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-10c7f564-e48d-436c-95ae-202237b0b833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.346904] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('10c7f564-e48d-436c-95ae-202237b0b833',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.348296] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-32ff0aad-cfa5-4379-8483-9c7077a46f10 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.348585] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-32ff0aad-cfa5-4379-8483-9c7077a46f10" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.348680] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-32ff0aad-cfa5-4379-8483-9c7077a46f10" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.348979] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-32ff0aad-cfa5-4379-8483-9c7077a46f10" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.349498] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('32ff0aad-cfa5-4379-8483-9c7077a46f10',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.350810] env[66502]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 819.350810] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aba51398-48dc-4f5e-b3cf-1da4130d58fb taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.351084] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.351084] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.351208] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.351371] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.352465] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b96da033-21f1-44bb-a822-a4cb59139771 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.352577] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.352642] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.353069] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.353069] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b96da033-21f1-44bb-a822-a4cb59139771',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.354029] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d777850f-4bcd-420d-ab88-295134770a5c taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.354145] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.354210] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.354379] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.354453] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d777850f-4bcd-420d-ab88-295134770a5c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.355541] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.355541] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.355723] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.355907] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.356520] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ab1d50c-f5a6-4aaf-829b-d0cfdf164722',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.357157] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.357264] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.357450] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7d21481-83aa-4bac-bea4-1030ed0a857b taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.357590] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7d21481-83aa-4bac-bea4-1030ed0a857b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.357647] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7d21481-83aa-4bac-bea4-1030ed0a857b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.357791] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7d21481-83aa-4bac-bea4-1030ed0a857b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.357868] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7d21481-83aa-4bac-bea4-1030ed0a857b',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.359086] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25ed9582-5ba1-4260-bd41-77518f4c6d14 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.359086] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25ed9582-5ba1-4260-bd41-77518f4c6d14" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.359086] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25ed9582-5ba1-4260-bd41-77518f4c6d14" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.359286] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25ed9582-5ba1-4260-bd41-77518f4c6d14" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.359325] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25ed9582-5ba1-4260-bd41-77518f4c6d14',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.360343] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bb24e830-31ca-4b75-ba92-3835430fbf29 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.360458] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bb24e830-31ca-4b75-ba92-3835430fbf29" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.360458] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bb24e830-31ca-4b75-ba92-3835430fbf29" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.360846] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bb24e830-31ca-4b75-ba92-3835430fbf29" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.360846] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bb24e830-31ca-4b75-ba92-3835430fbf29',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.361835] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ba4a0494-e0b7-44c9-b74f-00469639644c taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.361964] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ba4a0494-e0b7-44c9-b74f-00469639644c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.362026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ba4a0494-e0b7-44c9-b74f-00469639644c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.362201] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ba4a0494-e0b7-44c9-b74f-00469639644c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.362275] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ba4a0494-e0b7-44c9-b74f-00469639644c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.363196] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6215e376-fd44-487b-9cf4-9b65dd953e4e taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.363352] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6215e376-fd44-487b-9cf4-9b65dd953e4e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.363455] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6215e376-fd44-487b-9cf4-9b65dd953e4e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.363725] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6215e376-fd44-487b-9cf4-9b65dd953e4e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.363815] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6215e376-fd44-487b-9cf4-9b65dd953e4e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.364742] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.364855] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.364931] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.365080] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.365241] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.365474] env[66502]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 819.563729] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b96da033-21f1-44bb-a822-a4cb59139771 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.563729] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.563729] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.564105] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.564105] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.564105] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.564239] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.564277] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.564395] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.564476] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.564565] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b96da033-21f1-44bb-a822-a4cb59139771',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.569351] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.569499] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.569734] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.569965] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.572357] env[66502]: INFO networking_nsxv3.common.synchronization [None req-4f241915-b6b8-4aa6-8fd1-3c3500e09c0a tempest-ServerActionsTestJSON-2133613622 tempest-ServerActionsTestJSON-2133613622-project-member] Enqueued Resource ID: b10a43dc-2d28-4687-a424-05a1ebdfa3c3 with Priority: HIGHEST for action security_group_rules [ 819.578774] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b10a43dc-2d28-4687-a424-05a1ebdfa3c3 with Priority: HIGHEST for action security_group_rules [ 819.581813] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b10a43dc-2d28-4687-a424-05a1ebdfa3c3 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.581939] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b10a43dc-2d28-4687-a424-05a1ebdfa3c3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.604917] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.605231] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.605410] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.605479] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.605900] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.605900] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.605900] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 is going to be updated. [ 819.608724] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.608872] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.608967] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.609153] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.611706] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.611823] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.635616] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.635616] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 10c7f564-e48d-436c-95ae-202237b0b833 is going to be deleted. [ 819.637316] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.637913] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.639398] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.639536] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.639616] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.639777] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.640295] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.663219] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 in Status: IN_PROGRESS for 2s [ 819.671723] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.671874] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d777850f-4bcd-420d-ab88-295134770a5c is going to be deleted. [ 819.742368] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.742728] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.742981] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.743314] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.743505] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.743750] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-10c7f564-e48d-436c-95ae-202237b0b833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.744649] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.744895] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.745058] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.745312] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.745491] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.745723] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d777850f-4bcd-420d-ab88-295134770a5c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.869256] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.869414] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.869490] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.870155] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.870155] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.870155] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.870155] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.870389] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.870389] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.870475] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.870575] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.872097] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.872202] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.872276] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.872499] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.872621] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.872758] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.872811] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.873024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.874826] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.874950] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.875124] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.911616] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.911828] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.911828] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.912114] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.912240] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.912340] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b10a43dc-2d28-4687-a424-05a1ebdfa3c3 already deleted. [ 819.912414] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b10a43dc-2d28-4687-a424-05a1ebdfa3c3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.913249] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b10a43dc-2d28-4687-a424-05a1ebdfa3c3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.913249] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b10a43dc-2d28-4687-a424-05a1ebdfa3c3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.913504] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b10a43dc-2d28-4687-a424-05a1ebdfa3c3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.064311] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.064311] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.064311] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.064311] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.064311] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.064311] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.064311] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.064311] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.064678] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.064678] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.064678] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8ab1d50c-f5a6-4aaf-829b-d0cfdf164722',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.068147] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b96da033-21f1-44bb-a822-a4cb59139771 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.068342] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.068342] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.069082] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.069288] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.069288] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.069288] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.069774] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.069896] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.069963] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.070145] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b96da033-21f1-44bb-a822-a4cb59139771 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.070250] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.070312] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.070501] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.070599] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.070686] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.070743] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.070880] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.070953] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.071583] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.071583] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b96da033-21f1-44bb-a822-a4cb59139771',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.078845] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7d21481-83aa-4bac-bea4-1030ed0a857b taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.078845] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7d21481-83aa-4bac-bea4-1030ed0a857b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.078845] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7d21481-83aa-4bac-bea4-1030ed0a857b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.079057] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7d21481-83aa-4bac-bea4-1030ed0a857b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.079398] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.079821] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.079908] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.080097] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.080186] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.080271] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7d21481-83aa-4bac-bea4-1030ed0a857b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.080356] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c7d21481-83aa-4bac-bea4-1030ed0a857b',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.102623] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.102786] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.102786] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.102998] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.143455] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.143617] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.147642] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.147642] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.147642] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.147642] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.147642] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.147642] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.148412] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.148514] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.149180] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.149278] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.150137] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.150137] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.151261] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.151352] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.151968] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.152075] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.152758] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.152893] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.153507] env[66502]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 820.153896] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.153989] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.154793] env[66502]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 820.155355] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.156027] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25ed9582-5ba1-4260-bd41-77518f4c6d14 is going to be deleted. [ 820.156431] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.156636] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.159899] env[66502]: INFO networking_nsxv3.common.synchronization [req-8c4204d8-4501-44ea-82b6-a2328ec4da07 req-ad81c9e5-327f-41ad-9e71-e2f3465820d9 tempest-ServerAddressesTestJSON-2031359937 tempest-ServerAddressesTestJSON-2031359937-project-member] Enqueued Resource ID: 0204e1c6-c967-43a4-828f-5c28ecb8f527 with Priority: HIGHEST for action security_group_members [ 820.160800] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0204e1c6-c967-43a4-828f-5c28ecb8f527 with Priority: HIGHEST for action security_group_members [ 820.161221] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0204e1c6-c967-43a4-828f-5c28ecb8f527 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.161335] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0204e1c6-c967-43a4-828f-5c28ecb8f527" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.161393] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0204e1c6-c967-43a4-828f-5c28ecb8f527" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.161993] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0204e1c6-c967-43a4-828f-5c28ecb8f527" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.162908] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.163054] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.163125] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.163294] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.163553] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.163553] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0204e1c6-c967-43a4-828f-5c28ecb8f527',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.177204] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.177338] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ba4a0494-e0b7-44c9-b74f-00469639644c is going to be deleted. [ 820.178706] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.179920] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.201159] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.201297] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49 is going to be deleted. [ 820.202255] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.202466] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.214104] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.214503] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.227178] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.227446] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 96893623-1913-4658-8960-6e93015a062e is going to be deleted. [ 820.228449] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.228661] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.243757] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.244349] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.272520] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.272656] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb is going to be deleted. [ 820.274235] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.274347] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.274415] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.274617] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.274704] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.274821] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2ef7d6d3-6d38-4fcf-a285-2f0d93f14d49" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.274987] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.275163] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.315843] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.315843] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f4a2c28-0514-4b56-8107-7969d0d9335c is going to be deleted. [ 820.316776] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.317103] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.345845] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.345990] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.376699] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.376973] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.377082] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.377419] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.377682] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.378264] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.378264] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.378264] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.378264] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.378461] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.378605] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.378740] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.378830] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.379046] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.379250] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.379406] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.379458] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.379658] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.379748] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.379837] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.379929] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.382230] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.382416] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.382521] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.382728] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.382892] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.383067] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.383067] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.383221] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.383549] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.383549] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.383549] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.383891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.383891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.384033] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.384192] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.384350] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.384390] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.384849] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.385052] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.385052] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.385190] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.388054] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.388263] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75e42630-d365-4bb0-89c0-55b0baee0268 is going to be deleted. [ 820.389372] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.389775] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.438652] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.438803] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6215e376-fd44-487b-9cf4-9b65dd953e4e is going to be deleted. [ 820.439772] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.440014] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.461155] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.461357] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.465385] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.465653] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b1dbab98-9c58-424b-aadb-07860f808828 is going to be deleted. [ 820.466682] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.466877] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.502284] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.502284] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.517555] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.517555] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.517955] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.518056] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.522682] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.522801] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 32ff0aad-cfa5-4379-8483-9c7077a46f10 is going to be deleted. [ 820.524314] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.524314] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.525648] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.525839] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.563037] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-950 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.563037] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-950" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.563037] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-950" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.563286] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-950" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.563365] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.563518] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.563662] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.563903] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.564059] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.564267] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 820.564579] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 820.564579] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 820.564579] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 820.564762] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 820.564762] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 820.564881] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 820.568929] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8ab1d50c-f5a6-4aaf-829b-d0cfdf164722',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.573940] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b96da033-21f1-44bb-a822-a4cb59139771: rpc.has_security_group_logging(os_id): False [ 820.582400] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.582536] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea is going to be deleted. [ 820.583814] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.584047] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.584146] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.584270] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25ed9582-5ba1-4260-bd41-77518f4c6d14" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.584710] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.584917] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.585076] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.585151] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ba4a0494-e0b7-44c9-b74f-00469639644c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.585626] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.585871] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.595875] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c7d21481-83aa-4bac-bea4-1030ed0a857b',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.605146] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.605146] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.619120] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 820.619299] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.054 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 820.619434] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 820.619883] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-950" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.619995] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-f6df5686-bea9-4340-8e5a-826a4221ad85 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.620107] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-f6df5686-bea9-4340-8e5a-826a4221ad85" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.620225] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-f6df5686-bea9-4340-8e5a-826a4221ad85" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.620566] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-f6df5686-bea9-4340-8e5a-826a4221ad85" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.620702] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6df5686-bea9-4340-8e5a-826a4221ad85',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.628587] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.628728] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.641730] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.641911] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bb24e830-31ca-4b75-ba92-3835430fbf29 is going to be deleted. [ 820.643144] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.643144] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.643299] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.643351] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-96893623-1913-4658-8960-6e93015a062e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.644362] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.644561] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.645776] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.645938] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f4a2c28-0514-4b56-8107-7969d0d9335c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.646791] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.646987] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.647124] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.647238] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b10a43dc-2d28-4687-a424-05a1ebdfa3c3 already deleted. [ 820.647325] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b10a43dc-2d28-4687-a424-05a1ebdfa3c3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.647467] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.647665] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.647711] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.647799] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.647934] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.648093] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.648169] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.648281] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6215e376-fd44-487b-9cf4-9b65dd953e4e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.648408] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.648547] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.648619] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.648729] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75e42630-d365-4bb0-89c0-55b0baee0268" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.649195] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.649294] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.649385] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.649494] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b1dbab98-9c58-424b-aadb-07860f808828" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.649609] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.649749] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.665524] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.665660] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.694042] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.694042] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.738119] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.738501] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.738642] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.738714] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.738908] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.738988] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.739243] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.739349] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.739409] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.739578] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.739653] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.739878] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.740018] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.740018] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.740137] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.740195] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.740287] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b96da033-21f1-44bb-a822-a4cb59139771 is going to be updated. [ 820.741415] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.741585] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.741668] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.741908] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.742047] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.742126] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.742259] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.742329] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.742413] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0204e1c6-c967-43a4-828f-5c28ecb8f527 already deleted. [ 820.742590] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0204e1c6-c967-43a4-828f-5c28ecb8f527" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.742737] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.742885] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.742963] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.743087] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-32ff0aad-cfa5-4379-8483-9c7077a46f10" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.762639] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.762896] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.762896] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.763120] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.763220] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.763328] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.792713] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.792858] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.793082] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.793167] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.793259] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.793387] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bb24e830-31ca-4b75-ba92-3835430fbf29" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.887847] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9d226a97-2d69-4706-b98b-565700008c6f: rpc.has_security_group_logging(os_id): False [ 820.889047] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ee2e9577-19ff-440d-9bd8-24dbaf88ea24: rpc.has_security_group_logging(os_id): False [ 821.032074] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.032320] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.032421] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.032794] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.032990] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.045428] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.045603] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.046211] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.046211] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.048586] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.048779] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.071358] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722: rpc.has_security_group_logging(os_id): False [ 821.080993] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b96da033-21f1-44bb-a822-a4cb59139771 in Status: IN_PROGRESS for 2s [ 821.093420] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.093782] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.093976] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.093976] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.094290] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.094418] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.094698] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.094862] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.094958] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.095136] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.095258] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.095475] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.095603] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.095721] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.095869] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.095944] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.096062] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 is going to be updated. [ 821.097367] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.097668] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.098812] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c7d21481-83aa-4bac-bea4-1030ed0a857b: rpc.has_security_group_logging(os_id): False [ 821.126494] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.126700] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.127200] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.127441] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.127545] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.127820] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.127981] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.128178] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port f6df5686-bea9-4340-8e5a-826a4221ad85 not found, creating... [ 821.128477] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.128643] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.128791] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.129049] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.129203] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.129495] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.129644] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.129765] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.129977] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.130122] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.130259] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: f6df5686-bea9-4340-8e5a-826a4221ad85 is going to be created. [ 821.132378] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.132625] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.133460] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.133721] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.133888] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.133983] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.134128] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.134220] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.134416] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.134538] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.134721] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.134919] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.134919] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.135118] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.135118] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.135313] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.135313] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.135579] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.135579] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d226a97-2d69-4706-b98b-565700008c6f is going to be updated. [ 821.137060] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.137244] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.179550] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.180242] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.180435] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.180520] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.181037] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.181037] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.181298] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7d21481-83aa-4bac-bea4-1030ed0a857b is going to be updated. [ 821.183683] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.184062] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.204945] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.205414] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.205605] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.206126] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.206501] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.206886] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-f6df5686-bea9-4340-8e5a-826a4221ad85" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.220677] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.221073] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.221251] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.221318] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.221605] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.221731] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.221794] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 is going to be updated. [ 821.275084] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.275424] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.275424] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.275849] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.276112] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.289538] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 in Status: SUCCESS [ 821.289815] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.289998] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.290287] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.290516] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.290639] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.290704] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.290867] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.290985] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.291089] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.291183] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ddb3b9a8-c63d-4123-aa7f-cbf2b5279231',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.319252] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 in Status: IN_PROGRESS for 2s [ 821.379367] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.379609] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.379728] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.379976] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.380204] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.391941] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.392159] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.392225] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.392452] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.392598] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.420165] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.420165] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.420165] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.420165] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.420165] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.445063] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: IN_PROGRESS for 2s [ 821.446697] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7d21481-83aa-4bac-bea4-1030ed0a857b in Status: IN_PROGRESS for 2s [ 821.461393] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 in Status: IN_PROGRESS for 2s [ 821.675327] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 in Status: SUCCESS [ 821.676920] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 deletion is rescheduled due to dependency. [ 821.676920] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.676920] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.676920] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.676920] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.676920] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.677318] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.677318] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.677318] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.677318] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.793537] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.793741] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.793838] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.794024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.794213] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.794312] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.794373] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.794748] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.794901] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.794966] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.795115] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.795203] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.795265] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.795410] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.795550] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.795629] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.795761] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.795907] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.796043] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.796176] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.796314] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ddb3b9a8-c63d-4123-aa7f-cbf2b5279231',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.939536] env[66502]: INFO networking_nsxv3.common.synchronization [req-8c4204d8-4501-44ea-82b6-a2328ec4da07 req-dff94e02-da18-4e39-8506-6b2172da8ed9 service nova] Enqueued Resource ID: 0204e1c6-c967-43a4-828f-5c28ecb8f527 with Priority: HIGHEST for action security_group_rules [ 821.939655] env[66502]: INFO networking_nsxv3.common.synchronization [req-8c4204d8-4501-44ea-82b6-a2328ec4da07 req-dff94e02-da18-4e39-8506-6b2172da8ed9 service nova] Enqueued Resource ID: 0204e1c6-c967-43a4-828f-5c28ecb8f527 with Priority: HIGHEST for action security_group_members [ 821.939791] env[66502]: INFO networking_nsxv3.common.synchronization [req-8c4204d8-4501-44ea-82b6-a2328ec4da07 req-dff94e02-da18-4e39-8506-6b2172da8ed9 service nova] Enqueued Resource ID: f6df5686-bea9-4340-8e5a-826a4221ad85 with Priority: HIGHEST for action port [ 821.940322] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0204e1c6-c967-43a4-828f-5c28ecb8f527 with Priority: HIGHEST for action security_group_rules [ 821.940454] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0204e1c6-c967-43a4-828f-5c28ecb8f527 with Priority: HIGHEST for action security_group_members [ 821.940748] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6df5686-bea9-4340-8e5a-826a4221ad85 with Priority: HIGHEST for action port [ 821.941127] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0204e1c6-c967-43a4-828f-5c28ecb8f527 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.941198] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0204e1c6-c967-43a4-828f-5c28ecb8f527" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.941297] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0204e1c6-c967-43a4-828f-5c28ecb8f527" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.941582] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0204e1c6-c967-43a4-828f-5c28ecb8f527" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.942746] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0204e1c6-c967-43a4-828f-5c28ecb8f527',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.942746] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0204e1c6-c967-43a4-828f-5c28ecb8f527 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.942746] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0204e1c6-c967-43a4-828f-5c28ecb8f527" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.942746] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0204e1c6-c967-43a4-828f-5c28ecb8f527" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.943060] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0204e1c6-c967-43a4-828f-5c28ecb8f527" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.943060] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.943142] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.943305] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.943467] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.943568] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.943648] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0204e1c6-c967-43a4-828f-5c28ecb8f527',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.944896] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6df5686-bea9-4340-8e5a-826a4221ad85 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.945017] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6df5686-bea9-4340-8e5a-826a4221ad85" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.945085] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6df5686-bea9-4340-8e5a-826a4221ad85" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.945264] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6df5686-bea9-4340-8e5a-826a4221ad85" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.945321] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6df5686-bea9-4340-8e5a-826a4221ad85',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.181691] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.181691] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.181691] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.181980] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.182088] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.182341] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.182431] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.182510] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.182756] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.182885] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.183018] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 is going to be updated. [ 822.213977] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.214160] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.214225] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.214481] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.214583] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.225540] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 in Status: IN_PROGRESS for 2s [ 822.300340] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ddb3b9a8-c63d-4123-aa7f-cbf2b5279231: rpc.has_security_group_logging(os_id): False [ 822.327420] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.327580] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.327669] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.327869] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.349294] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.349549] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.349665] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.349731] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.349931] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.350025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.350233] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.350330] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.350756] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.350756] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.350756] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.350917] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.351027] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.351390] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.351390] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.351390] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.351390] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 is going to be updated. [ 822.422578] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.422975] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.422975] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.423123] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.424175] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.438773] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 in Status: IN_PROGRESS for 2s [ 822.445269] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0204e1c6-c967-43a4-828f-5c28ecb8f527',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.449321] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f6df5686-bea9-4340-8e5a-826a4221ad85 with status ACTIVE [ 822.449630] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.449777] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.449777] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.450625] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.450625] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.450625] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.450625] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.450625] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.451012] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.451012] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.451012] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.451199] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.451199] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.451325] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.451325] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.451443] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f6df5686-bea9-4340-8e5a-826a4221ad85 is going to be updated. [ 822.454604] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0204e1c6-c967-43a4-828f-5c28ecb8f527 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.454829] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0204e1c6-c967-43a4-828f-5c28ecb8f527" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.481615] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.481889] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.481889] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.482034] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.482171] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.482383] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6df5686-bea9-4340-8e5a-826a4221ad85" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.719677] env[66502]: INFO networking_nsxv3.common.synchronization [req-f0ad5955-e3f9-440c-b06c-0683af59da30 req-a2b66b98-0c0c-4393-ac07-cc530707c89c tempest-ServerDiskConfigTestJSON-940033598 tempest-ServerDiskConfigTestJSON-940033598-project-member] Enqueued Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGHEST for action security_group_members [ 822.720295] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGHEST for action security_group_members [ 822.720567] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-aba51398-48dc-4f5e-b3cf-1da4130d58fb taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.720692] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.720759] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.723321] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.723321] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.723321] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.723321] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.723321] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.723321] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.723321] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.947474] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0204e1c6-c967-43a4-828f-5c28ecb8f527',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.101110] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b96da033-21f1-44bb-a822-a4cb59139771 in Status: SUCCESS [ 823.101110] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.139160] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-509 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.139782] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-509" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.141097] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-509" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.141097] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-509" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.141097] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.141097] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.141097] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.142627] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.142627] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.142627] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 823.142627] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 823.142627] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 823.145271] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 823.145271] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 823.145271] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 823.145271] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 823.163756] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 823.163962] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 823.164108] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 823.164279] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-509" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.164602] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-841f11d9-fd4c-435d-bd44-c603a333d207 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.164764] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-841f11d9-fd4c-435d-bd44-c603a333d207" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.164878] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-841f11d9-fd4c-435d-bd44-c603a333d207" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.165653] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-841f11d9-fd4c-435d-bd44-c603a333d207" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.165653] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('841f11d9-fd4c-435d-bd44-c603a333d207',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.228840] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.228840] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.228999] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.229193] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.229246] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.230021] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.230158] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.230216] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.230376] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.230455] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.230872] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb is going to be deleted. [ 823.271119] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.271347] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.271347] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.271568] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.271676] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.271777] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.338956] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 in Status: SUCCESS [ 823.339324] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.455372] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.455531] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.455531] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.455769] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.455865] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.455964] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0204e1c6-c967-43a4-828f-5c28ecb8f527 is going to be created. [ 823.460960] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c7d21481-83aa-4bac-bea4-1030ed0a857b in Status: SUCCESS [ 823.461209] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7d21481-83aa-4bac-bea4-1030ed0a857b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.466214] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: SUCCESS [ 823.466442] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.472637] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 in Status: SUCCESS [ 823.472852] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.481707] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.481846] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.481906] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.482132] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.482862] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.494140] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0204e1c6-c967-43a4-828f-5c28ecb8f527 in Status: UNINITIALIZED for 2s [ 823.668940] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.669354] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.669508] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.669814] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.669963] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.670158] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 841f11d9-fd4c-435d-bd44-c603a333d207 not found, creating... [ 823.670422] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.670583] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.670695] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.670917] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.671061] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.671348] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.671499] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.671610] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.671806] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.671946] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.672089] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 841f11d9-fd4c-435d-bd44-c603a333d207 is going to be created. [ 823.693068] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.693273] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.693390] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.693717] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.693929] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.694170] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-841f11d9-fd4c-435d-bd44-c603a333d207" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.236899] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 in Status: IN_PROGRESS for 4s [ 824.423346] env[66502]: INFO networking_nsxv3.common.synchronization [req-f0ad5955-e3f9-440c-b06c-0683af59da30 req-7535f85f-033b-479c-a648-a37d0d662f01 service nova] Enqueued Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGHEST for action security_group_rules [ 824.423692] env[66502]: INFO networking_nsxv3.common.synchronization [req-f0ad5955-e3f9-440c-b06c-0683af59da30 req-7535f85f-033b-479c-a648-a37d0d662f01 service nova] Enqueued Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGHEST for action security_group_members [ 824.423692] env[66502]: INFO networking_nsxv3.common.synchronization [req-f0ad5955-e3f9-440c-b06c-0683af59da30 req-7535f85f-033b-479c-a648-a37d0d662f01 service nova] Enqueued Resource ID: 841f11d9-fd4c-435d-bd44-c603a333d207 with Priority: HIGHEST for action port [ 824.424327] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGHEST for action security_group_rules [ 824.424467] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGHEST for action security_group_members [ 824.424562] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 841f11d9-fd4c-435d-bd44-c603a333d207 with Priority: HIGHEST for action port [ 824.424849] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aba51398-48dc-4f5e-b3cf-1da4130d58fb taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.424979] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.425106] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.425744] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.425909] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.426907] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-aba51398-48dc-4f5e-b3cf-1da4130d58fb taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.427116] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.427206] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.427538] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.427590] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.427995] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.428078] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.430544] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.430544] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.430544] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.430544] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-841f11d9-fd4c-435d-bd44-c603a333d207 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.430544] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-841f11d9-fd4c-435d-bd44-c603a333d207" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.430544] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-841f11d9-fd4c-435d-bd44-c603a333d207" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.430544] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-841f11d9-fd4c-435d-bd44-c603a333d207" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.430544] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('841f11d9-fd4c-435d-bd44-c603a333d207',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.461070] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 in Status: SUCCESS [ 824.461070] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.461383] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.463020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.463020] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ddb3b9a8-c63d-4123-aa7f-cbf2b5279231',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.936309] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-aba51398-48dc-4f5e-b3cf-1da4130d58fb taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.937560] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.937560] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.938906] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 841f11d9-fd4c-435d-bd44-c603a333d207 with status ACTIVE [ 824.939139] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.939274] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.939377] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.939544] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.939628] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.939815] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.939908] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.939974] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.940874] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.941346] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.941665] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.941907] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.941907] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.942198] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.942369] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.942550] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 841f11d9-fd4c-435d-bd44-c603a333d207 is going to be updated. [ 824.963772] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.966680] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.966680] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.966680] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.966680] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.966680] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.966680] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.966680] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.966680] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.966680] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.966680] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ddb3b9a8-c63d-4123-aa7f-cbf2b5279231',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.967314] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.967479] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.967566] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.967729] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.967853] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.968036] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-841f11d9-fd4c-435d-bd44-c603a333d207" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.232662] env[66502]: INFO networking_nsxv3.common.synchronization [None req-0fc13259-c6ea-45d5-8a52-6999729e6731 None None] Enqueued Resource ID: c0a65302-8c56-45c7-9137-2dcb2b8f3ac0 with Priority: HIGHEST for action port [ 825.233350] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0a65302-8c56-45c7-9137-2dcb2b8f3ac0 with Priority: HIGHEST for action port [ 825.233530] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0a65302-8c56-45c7-9137-2dcb2b8f3ac0 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.233671] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0a65302-8c56-45c7-9137-2dcb2b8f3ac0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.233733] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0a65302-8c56-45c7-9137-2dcb2b8f3ac0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.234171] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0a65302-8c56-45c7-9137-2dcb2b8f3ac0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.234285] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0a65302-8c56-45c7-9137-2dcb2b8f3ac0',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.249639] env[66502]: INFO networking_nsxv3.common.synchronization [req-04d3488a-09f3-4683-b6e7-2cd998c5116b req-93925f19-06a0-4800-acbc-4cf7b4388950 tempest-InstanceActionsV221TestJSON-275275078 tempest-InstanceActionsV221TestJSON-275275078-project-member] Enqueued Resource ID: fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5 with Priority: HIGHEST for action security_group_members [ 825.250162] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5 with Priority: HIGHEST for action security_group_members [ 825.250465] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.250582] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.250655] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.251047] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.251047] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.251227] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.251227] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.251345] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.251402] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.251451] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.445333] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.471020] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.471020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.471020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.471020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.471020] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.471020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.471020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.471020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.471020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.471460] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.471635] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.471739] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.471797] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.471956] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.472106] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.472194] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.472251] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.472386] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.472457] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.473218] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.473218] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ddb3b9a8-c63d-4123-aa7f-cbf2b5279231',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.505148] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0204e1c6-c967-43a4-828f-5c28ecb8f527 in Status: SUCCESS [ 825.505580] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0204e1c6-c967-43a4-828f-5c28ecb8f527" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.506289] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0204e1c6-c967-43a4-828f-5c28ecb8f527" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.506669] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0204e1c6-c967-43a4-828f-5c28ecb8f527" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.507171] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.508117] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.508117] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.508286] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.508399] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.508515] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0204e1c6-c967-43a4-828f-5c28ecb8f527" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.508633] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0204e1c6-c967-43a4-828f-5c28ecb8f527',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.630648] env[66502]: INFO networking_nsxv3.common.synchronization [req-e9bfb7c3-1718-4f52-adf5-f4b43d6054aa req-5b6cd78e-79f4-4b8d-8009-6591abc16bd2 tempest-SecurityGroupsTestJSON-779026578 tempest-SecurityGroupsTestJSON-779026578-project-member] Enqueued Resource ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d with Priority: HIGHEST for action security_group_members [ 825.631233] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d with Priority: HIGHEST for action security_group_members [ 825.631522] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.631669] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.631756] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.633117] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.633117] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.633117] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.633117] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.633117] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.633117] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.633117] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.736917] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c0a65302-8c56-45c7-9137-2dcb2b8f3ac0 [ 825.737181] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.737778] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.737778] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.737778] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.737778] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.737778] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c0a65302-8c56-45c7-9137-2dcb2b8f3ac0 already deleted. [ 825.738162] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0a65302-8c56-45c7-9137-2dcb2b8f3ac0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.753348] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.753861] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.754075] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.754378] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.777511] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.777511] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.777511] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.777511] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.777511] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.777511] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.777511] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5 is going to be updated. [ 825.811019] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.811019] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.811019] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.811019] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.811019] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.819330] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5 in Status: IN_PROGRESS for 2s [ 825.948126] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.948296] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.948368] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.948592] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.948685] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.948783] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb is going to be created. [ 825.975771] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.975969] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.976104] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.976273] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.976439] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.977933] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ddb3b9a8-c63d-4123-aa7f-cbf2b5279231: rpc.has_security_group_logging(os_id): False [ 825.988990] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb in Status: UNINITIALIZED for 2s [ 825.995665] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.995665] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.995665] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.995989] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.996145] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.996430] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.996627] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.996752] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.996991] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.997235] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.998780] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.998780] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.998780] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.998780] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.998780] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.998780] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.998780] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.998780] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.998780] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.998780] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.998780] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 is going to be updated. [ 826.011912] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0204e1c6-c967-43a4-828f-5c28ecb8f527 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.011912] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0204e1c6-c967-43a4-828f-5c28ecb8f527" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.011912] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0204e1c6-c967-43a4-828f-5c28ecb8f527" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.011912] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0204e1c6-c967-43a4-828f-5c28ecb8f527" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.012120] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.012182] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.012358] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.012474] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.012563] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.012736] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0204e1c6-c967-43a4-828f-5c28ecb8f527" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.012985] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0204e1c6-c967-43a4-828f-5c28ecb8f527 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.012985] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0204e1c6-c967-43a4-828f-5c28ecb8f527" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.013113] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0204e1c6-c967-43a4-828f-5c28ecb8f527" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.014341] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0204e1c6-c967-43a4-828f-5c28ecb8f527" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.014341] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.014341] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.014341] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.014341] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.014341] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.014341] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0204e1c6-c967-43a4-828f-5c28ecb8f527" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.014341] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0204e1c6-c967-43a4-828f-5c28ecb8f527',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.047686] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-342 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.047686] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-342" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.047686] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-342" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.047686] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-342" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.048117] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.048117] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.048117] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.048323] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.048466] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.049013] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 826.049013] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 826.049013] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 826.049013] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 826.049315] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 826.049315] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 826.049315] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 826.133405] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 826.133698] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.084 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 826.133698] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 826.134758] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-342" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.135167] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-2c1b965c-cee0-4b6e-8951-a26c98608cc0 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.135351] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-2c1b965c-cee0-4b6e-8951-a26c98608cc0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.135470] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-2c1b965c-cee0-4b6e-8951-a26c98608cc0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.135858] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-2c1b965c-cee0-4b6e-8951-a26c98608cc0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.136011] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c1b965c-cee0-4b6e-8951-a26c98608cc0',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 826.137215] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.137358] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.137450] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.137668] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.137782] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.138010] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.138155] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.138208] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.138439] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.138439] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.138586] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d already deleted. [ 826.138819] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.153829] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.153941] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.154013] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.154192] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.154768] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.248197] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 in Status: IN_PROGRESS for 2s [ 826.256293] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 in Status: SUCCESS [ 826.256293] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 deletion is rescheduled due to dependency. [ 826.256293] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.517204] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0204e1c6-c967-43a4-828f-5c28ecb8f527: rpc.has_security_group_logging(os_id): False [ 826.549423] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.549423] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.549423] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.549423] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.549423] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.549423] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.549423] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.549423] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.550663] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.550663] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.550663] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.550663] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.550663] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.550663] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.550663] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.550663] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.551274] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.551274] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.552471] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.552471] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.552471] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0204e1c6-c967-43a4-828f-5c28ecb8f527 is going to be created. [ 826.644886] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.644972] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.645060] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.645271] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.645819] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.647246] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.647366] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.647446] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.647730] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.648638] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.648638] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port 2c1b965c-cee0-4b6e-8951-a26c98608cc0 not found, creating... [ 826.648638] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.648638] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.648638] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.648982] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.648982] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.649812] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.649812] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.649812] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.649812] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.649812] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.649812] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: 2c1b965c-cee0-4b6e-8951-a26c98608cc0 is going to be created. [ 826.676458] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0204e1c6-c967-43a4-828f-5c28ecb8f527 in Status: IN_PROGRESS for 2s [ 826.680793] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.680793] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.680793] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.681069] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.681337] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.681707] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-2c1b965c-cee0-4b6e-8951-a26c98608cc0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.986830] env[66502]: INFO networking_nsxv3.common.synchronization [req-66064c7e-bcc9-4a1b-9f7f-25e4d968b8fa req-846ea388-82ae-4a0f-b1b5-9739786b51fb tempest-SecurityGroupRulesTestJSON-1133487754 tempest-SecurityGroupRulesTestJSON-1133487754-project-member] Enqueued Resource ID: 9b9fe8bc-ac39-4874-966e-73bfe14513ba with Priority: HIGHEST for action security_group_rules [ 826.986830] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b9fe8bc-ac39-4874-966e-73bfe14513ba with Priority: HIGHEST for action security_group_rules [ 826.986830] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9b9fe8bc-ac39-4874-966e-73bfe14513ba taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.986830] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9b9fe8bc-ac39-4874-966e-73bfe14513ba" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.986830] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9b9fe8bc-ac39-4874-966e-73bfe14513ba" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.987359] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9b9fe8bc-ac39-4874-966e-73bfe14513ba" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.987359] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9b9fe8bc-ac39-4874-966e-73bfe14513ba',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.337171] env[66502]: INFO networking_nsxv3.common.synchronization [req-e9bfb7c3-1718-4f52-adf5-f4b43d6054aa req-d4478507-2da7-4df9-ade4-d9cc80ac6617 service nova] Enqueued Resource ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d with Priority: HIGHEST for action security_group_rules [ 827.337171] env[66502]: INFO networking_nsxv3.common.synchronization [req-e9bfb7c3-1718-4f52-adf5-f4b43d6054aa req-d4478507-2da7-4df9-ade4-d9cc80ac6617 service nova] Enqueued Resource ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d with Priority: HIGHEST for action security_group_members [ 827.337171] env[66502]: INFO networking_nsxv3.common.synchronization [req-e9bfb7c3-1718-4f52-adf5-f4b43d6054aa req-d4478507-2da7-4df9-ade4-d9cc80ac6617 service nova] Enqueued Resource ID: 2c1b965c-cee0-4b6e-8951-a26c98608cc0 with Priority: HIGHEST for action port [ 827.337171] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d with Priority: HIGHEST for action security_group_rules [ 827.337171] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d with Priority: HIGHEST for action security_group_members [ 827.337171] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c1b965c-cee0-4b6e-8951-a26c98608cc0 with Priority: HIGHEST for action port [ 827.337171] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e5c2909-7671-4f4c-995e-cc0f19e2e48d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.337171] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.337171] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.337171] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.337171] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.338155] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.338155] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.338155] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.338470] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.338884] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.338884] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.338884] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.339071] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.339398] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.339398] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.342023] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c1b965c-cee0-4b6e-8951-a26c98608cc0 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.342181] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c1b965c-cee0-4b6e-8951-a26c98608cc0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.342252] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c1b965c-cee0-4b6e-8951-a26c98608cc0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.342417] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c1b965c-cee0-4b6e-8951-a26c98608cc0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.342741] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c1b965c-cee0-4b6e-8951-a26c98608cc0',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.510353] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.510529] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.510529] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.510718] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.510794] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.510883] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9b9fe8bc-ac39-4874-966e-73bfe14513ba already deleted. [ 827.510962] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9b9fe8bc-ac39-4874-966e-73bfe14513ba" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.672188] env[66502]: INFO networking_nsxv3.common.synchronization [None req-650932de-e6f6-40f4-9dee-31b408e73527 None None] Enqueued Resource ID: bb8bc709-3d13-4335-87f9-2719314783f3 with Priority: HIGHEST for action port [ 827.672753] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb8bc709-3d13-4335-87f9-2719314783f3 with Priority: HIGHEST for action port [ 827.673060] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb8bc709-3d13-4335-87f9-2719314783f3 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.673182] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb8bc709-3d13-4335-87f9-2719314783f3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.673250] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb8bc709-3d13-4335-87f9-2719314783f3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.673500] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb8bc709-3d13-4335-87f9-2719314783f3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.673584] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb8bc709-3d13-4335-87f9-2719314783f3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.836134] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5 in Status: SUCCESS [ 827.836361] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5 deletion is rescheduled due to dependency. [ 827.836422] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.843268] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.844900] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c1b965c-cee0-4b6e-8951-a26c98608cc0 with status ACTIVE [ 827.845026] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.845483] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.845483] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.845896] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.846129] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.846482] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.846581] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.846665] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.846877] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.847302] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.847302] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.847433] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.847507] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.847732] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.847841] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.848608] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c1b965c-cee0-4b6e-8951-a26c98608cc0 is going to be updated. [ 827.850708] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.850708] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.880355] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.880355] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.880355] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.880355] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.880641] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.880767] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c1b965c-cee0-4b6e-8951-a26c98608cc0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.959228] env[66502]: INFO networking_nsxv3.common.synchronization [req-8e9c427a-4c70-471e-bb87-3bfe346ec032 req-2beb2546-60dd-4fc3-9eaf-7d14bca7e733 tempest-SecurityGroupRulesTestJSON-1133487754 tempest-SecurityGroupRulesTestJSON-1133487754-project-member] Enqueued Resource ID: c5fcc2ae-8288-4f16-b2de-caf713530cda with Priority: HIGHEST for action security_group_rules [ 827.959818] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5fcc2ae-8288-4f16-b2de-caf713530cda with Priority: HIGHEST for action security_group_rules [ 827.960155] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c5fcc2ae-8288-4f16-b2de-caf713530cda taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.960278] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c5fcc2ae-8288-4f16-b2de-caf713530cda" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.960345] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c5fcc2ae-8288-4f16-b2de-caf713530cda" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.960641] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c5fcc2ae-8288-4f16-b2de-caf713530cda" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.960729] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c5fcc2ae-8288-4f16-b2de-caf713530cda',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.000983] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb in Status: SUCCESS [ 828.001341] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.001600] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.001917] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.002217] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.002406] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.002570] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.002758] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.002892] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.003045] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.003199] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.177629] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port bb8bc709-3d13-4335-87f9-2719314783f3 [ 828.177875] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.178149] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.178239] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.178462] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.178621] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.178661] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:bb8bc709-3d13-4335-87f9-2719314783f3 already deleted. [ 828.178714] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb8bc709-3d13-4335-87f9-2719314783f3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.234952] env[66502]: INFO networking_nsxv3.common.synchronization [req-82ddedfb-448f-4846-9408-27f9dffdf9d4 req-969ec3e9-60ae-4a78-bbec-8c32393a5ee5 tempest-ImagesTestJSON-1088460097 tempest-ImagesTestJSON-1088460097-project-member] Enqueued Resource ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 with Priority: HIGHEST for action security_group_members [ 828.235586] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 with Priority: HIGHEST for action security_group_members [ 828.235990] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.236141] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.236210] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.236412] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.236567] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.236698] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.236770] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.236969] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.237075] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.237173] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.264536] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 in Status: SUCCESS [ 828.264756] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.350930] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.483162] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.483330] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.483397] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.484052] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.484338] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.484338] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c5fcc2ae-8288-4f16-b2de-caf713530cda already deleted. [ 828.484408] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c5fcc2ae-8288-4f16-b2de-caf713530cda" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.506095] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-aba51398-48dc-4f5e-b3cf-1da4130d58fb taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.506569] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.506569] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.506569] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.506783] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.506884] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.506884] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.507054] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.507154] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.507218] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.507363] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-aba51398-48dc-4f5e-b3cf-1da4130d58fb taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.507449] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.507505] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.507661] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.507791] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.507934] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.507934] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.508123] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.508179] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.508228] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.508316] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.593676] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-545 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.593676] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-545" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.593676] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-545" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.593999] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-545" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.594324] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.594486] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.594616] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.594836] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.595010] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.595227] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 828.595504] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 828.595617] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 828.595827] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 828.595956] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 828.596088] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 828.596255] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 828.617122] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 828.617294] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 828.617431] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 828.617603] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-545" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.617941] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-ba555f7f-16e0-47fb-94d8-a4760bb83104 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.618156] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-ba555f7f-16e0-47fb-94d8-a4760bb83104" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.618277] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-ba555f7f-16e0-47fb-94d8-a4760bb83104" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.618602] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-ba555f7f-16e0-47fb-94d8-a4760bb83104" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.618736] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba555f7f-16e0-47fb-94d8-a4760bb83104',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.689270] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0204e1c6-c967-43a4-828f-5c28ecb8f527 in Status: SUCCESS [ 828.689270] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0204e1c6-c967-43a4-828f-5c28ecb8f527" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.739058] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.739251] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.739316] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.739533] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.761139] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.761413] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.761534] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.761600] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.761803] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.761886] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.761978] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 is going to be updated. [ 828.787925] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.788226] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.788325] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.788684] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.788859] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.799061] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 in Status: IN_PROGRESS for 2s [ 828.859835] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.859835] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.859835] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.859835] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.859835] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.859835] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d is going to be created. [ 828.889707] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.889707] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.889707] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.889707] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.889707] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.901768] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d in Status: UNINITIALIZED for 2s [ 829.010304] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aba51398-48dc-4f5e-b3cf-1da4130d58fb: rpc.has_security_group_logging(os_id): False [ 829.034240] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.034468] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.034521] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.034706] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.034795] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.035084] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.035198] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.035255] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.035456] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.035594] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.036585] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.036585] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.036585] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.036585] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.036585] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.036585] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.036585] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.037140] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.037140] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.037140] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.037140] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb is going to be created. [ 829.119492] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.119746] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.119746] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.119949] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.120078] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.123569] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.123902] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.123979] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.124265] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.124408] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.124557] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port ba555f7f-16e0-47fb-94d8-a4760bb83104 not found, creating... [ 829.124814] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.124964] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.125090] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.125303] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.125461] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.125737] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.125949] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.126097] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.126306] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.126425] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.126563] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: ba555f7f-16e0-47fb-94d8-a4760bb83104 is going to be created. [ 829.143303] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb in Status: IN_PROGRESS for 2s [ 829.158707] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.158997] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.159211] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.159559] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.159872] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.160205] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-ba555f7f-16e0-47fb-94d8-a4760bb83104" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.337840] env[66502]: INFO networking_nsxv3.common.synchronization [req-352ef126-20e7-428a-bbbf-5e5b6ef61b56 req-f2e31208-8209-4c96-b77f-4df85c4430e2 tempest-ListServerFiltersTestJSON-1482878491 tempest-ListServerFiltersTestJSON-1482878491-project-member] Enqueued Resource ID: b96da033-21f1-44bb-a822-a4cb59139771 with Priority: HIGHEST for action security_group_members [ 829.338530] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b96da033-21f1-44bb-a822-a4cb59139771 with Priority: HIGHEST for action security_group_members [ 829.338755] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b96da033-21f1-44bb-a822-a4cb59139771 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.338853] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.338919] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.339171] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.339327] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.339429] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.339490] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.339634] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.339717] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 829.339815] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b96da033-21f1-44bb-a822-a4cb59139771',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.691349] env[66502]: INFO networking_nsxv3.common.synchronization [req-019ab790-db4c-4492-8fcc-cffba1c99253 req-3b6d946f-39c2-412c-9490-0fda3a2a39dd tempest-SecurityGroupRulesTestJSON-1133487754 tempest-SecurityGroupRulesTestJSON-1133487754-project-member] Enqueued Resource ID: 6dae96d5-f9ba-4cb2-b0f3-693749f4cdc4 with Priority: HIGHEST for action security_group_rules [ 829.691770] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6dae96d5-f9ba-4cb2-b0f3-693749f4cdc4 with Priority: HIGHEST for action security_group_rules [ 829.692079] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6dae96d5-f9ba-4cb2-b0f3-693749f4cdc4 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.692218] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6dae96d5-f9ba-4cb2-b0f3-693749f4cdc4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.692268] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6dae96d5-f9ba-4cb2-b0f3-693749f4cdc4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.692518] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6dae96d5-f9ba-4cb2-b0f3-693749f4cdc4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.692604] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6dae96d5-f9ba-4cb2-b0f3-693749f4cdc4',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.842570] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b96da033-21f1-44bb-a822-a4cb59139771',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.917730] env[66502]: INFO networking_nsxv3.common.synchronization [req-82ddedfb-448f-4846-9408-27f9dffdf9d4 req-fcf876f9-b9b7-483b-92fa-771ecbd9c104 service nova] Enqueued Resource ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 with Priority: HIGHEST for action security_group_rules [ 829.917730] env[66502]: INFO networking_nsxv3.common.synchronization [req-82ddedfb-448f-4846-9408-27f9dffdf9d4 req-fcf876f9-b9b7-483b-92fa-771ecbd9c104 service nova] Enqueued Resource ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 with Priority: HIGHEST for action security_group_members [ 829.917730] env[66502]: INFO networking_nsxv3.common.synchronization [req-82ddedfb-448f-4846-9408-27f9dffdf9d4 req-fcf876f9-b9b7-483b-92fa-771ecbd9c104 service nova] Enqueued Resource ID: ba555f7f-16e0-47fb-94d8-a4760bb83104 with Priority: HIGHEST for action port [ 829.918744] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 with Priority: HIGHEST for action security_group_rules [ 829.918744] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 with Priority: HIGHEST for action security_group_members [ 829.918744] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ba555f7f-16e0-47fb-94d8-a4760bb83104 with Priority: HIGHEST for action port [ 829.919104] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.919104] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.919272] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.919424] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.919490] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 829.922972] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.922972] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.925076] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-ba555f7f-16e0-47fb-94d8-a4760bb83104 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 829.925076] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ba555f7f-16e0-47fb-94d8-a4760bb83104" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 829.925426] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ba555f7f-16e0-47fb-94d8-a4760bb83104" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 829.925426] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ba555f7f-16e0-47fb-94d8-a4760bb83104" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 829.925426] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ba555f7f-16e0-47fb-94d8-a4760bb83104',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.215133] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.215288] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.215353] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.215574] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.215661] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.215787] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6dae96d5-f9ba-4cb2-b0f3-693749f4cdc4 already deleted. [ 830.215867] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6dae96d5-f9ba-4cb2-b0f3-693749f4cdc4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.346175] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b96da033-21f1-44bb-a822-a4cb59139771',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.427788] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.427956] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.428238] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ba555f7f-16e0-47fb-94d8-a4760bb83104 with status ACTIVE [ 830.428419] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.428552] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.428619] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.430935] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.430935] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.430935] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.430935] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.430935] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.430935] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.430935] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.430935] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.430935] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.430935] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.430935] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.430935] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.430935] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ba555f7f-16e0-47fb-94d8-a4760bb83104 is going to be updated. [ 830.454404] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.454404] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.454404] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.454767] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.454937] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.455110] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ba555f7f-16e0-47fb-94d8-a4760bb83104" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.809838] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 in Status: SUCCESS [ 830.810153] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 deletion is rescheduled due to dependency. [ 830.810153] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.810319] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.810532] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.810715] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.810833] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.810893] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.811057] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.811143] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.811238] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.852128] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.852324] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.852395] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.852603] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.852683] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.852802] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b96da033-21f1-44bb-a822-a4cb59139771 is going to be updated. [ 830.889999] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.890481] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.890591] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.891446] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.891446] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.902271] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b96da033-21f1-44bb-a822-a4cb59139771 in Status: IN_PROGRESS for 2s [ 830.913249] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d in Status: SUCCESS [ 830.913436] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.914644] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.914999] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.914999] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.915126] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.915168] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.915400] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.915528] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.915665] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.915827] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 830.918068] env[66502]: INFO networking_nsxv3.common.synchronization [req-7c498577-2324-428a-981c-0bf883cd81e9 req-52c2e138-6ffd-4b9e-a61a-84fe1975be3d tempest-MigrationsAdminTest-636676794 tempest-MigrationsAdminTest-636676794-project-member] Enqueued Resource ID: b4dfff3d-ef74-48f2-8955-b975cccf84d9 with Priority: HIGHEST for action security_group_members [ 830.918922] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4dfff3d-ef74-48f2-8955-b975cccf84d9 with Priority: HIGHEST for action security_group_members [ 830.919685] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4dfff3d-ef74-48f2-8955-b975cccf84d9 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.919685] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.919685] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.919685] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.919914] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 830.919914] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 830.919914] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.920053] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.920116] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.920205] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4dfff3d-ef74-48f2-8955-b975cccf84d9',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.171790] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb in Status: SUCCESS [ 831.175043] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.303552] env[66502]: INFO networking_nsxv3.common.synchronization [req-b3c67180-06c6-42a3-8c83-7d47ea33881c req-c68470a3-bd71-4850-aede-dd3b218d66ec tempest-SecurityGroupRulesTestJSON-1133487754 tempest-SecurityGroupRulesTestJSON-1133487754-project-member] Enqueued Resource ID: d3d4558a-3e7c-4f51-bacf-49fdbfc49c38 with Priority: HIGHEST for action security_group_rules [ 831.306044] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d3d4558a-3e7c-4f51-bacf-49fdbfc49c38 with Priority: HIGHEST for action security_group_rules [ 831.306166] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d3d4558a-3e7c-4f51-bacf-49fdbfc49c38 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.306767] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d3d4558a-3e7c-4f51-bacf-49fdbfc49c38" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.306871] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d3d4558a-3e7c-4f51-bacf-49fdbfc49c38" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.307151] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d3d4558a-3e7c-4f51-bacf-49fdbfc49c38" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.307233] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d3d4558a-3e7c-4f51-bacf-49fdbfc49c38',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.313170] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.319620] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-670 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.319816] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.319937] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.320241] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.320493] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.320649] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.320761] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.320965] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.321113] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.321789] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 831.321913] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 831.323033] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 831.323033] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 831.323033] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 831.323033] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 831.323033] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 831.348288] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 831.348288] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 831.348288] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 831.348509] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.348858] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-e225da9e-2b6c-428f-becf-f147ff4ffa8e taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.349013] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-e225da9e-2b6c-428f-becf-f147ff4ffa8e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.349085] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-e225da9e-2b6c-428f-becf-f147ff4ffa8e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.349436] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-e225da9e-2b6c-428f-becf-f147ff4ffa8e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.349570] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e225da9e-2b6c-428f-becf-f147ff4ffa8e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.419682] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.419883] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.419929] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.420213] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.420388] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.420491] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.420572] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.421112] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.421319] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.421319] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.421485] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.421543] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.421600] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.421768] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.421916] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.422039] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.422102] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.422244] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.422337] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.422421] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.422518] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.423566] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4dfff3d-ef74-48f2-8955-b975cccf84d9',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.814860] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.832467] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.832467] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.832731] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.832815] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.833010] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.833156] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d3d4558a-3e7c-4f51-bacf-49fdbfc49c38 already deleted. [ 831.833267] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d3d4558a-3e7c-4f51-bacf-49fdbfc49c38" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.856480] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.856480] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.856480] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.856480] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.856480] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.856480] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port e225da9e-2b6c-428f-becf-f147ff4ffa8e not found, creating... [ 831.856480] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.856480] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.856480] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.856480] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.856480] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.856979] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.856979] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.856979] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.856979] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.856979] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.857543] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: e225da9e-2b6c-428f-becf-f147ff4ffa8e is going to be created. [ 831.879613] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.880330] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.880667] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.881179] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.882397] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.882900] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-e225da9e-2b6c-428f-becf-f147ff4ffa8e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.925408] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e5c2909-7671-4f4c-995e-cc0f19e2e48d: rpc.has_security_group_logging(os_id): False [ 831.926744] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4dfff3d-ef74-48f2-8955-b975cccf84d9',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.948804] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.948928] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.948976] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.949238] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.949332] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.949562] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.949663] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.949725] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.949899] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.949976] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.950163] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.950256] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.950313] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.950447] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.950734] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.950734] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.950819] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.950819] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.951733] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.951916] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.952029] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d is going to be created. [ 832.060009] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.060009] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.060009] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.060009] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.060009] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.074216] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d in Status: IN_PROGRESS for 2s [ 832.321388] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.321388] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.321388] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.321388] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.321388] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.321388] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 is going to be updated. [ 832.367605] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.367826] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.367940] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.368368] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.368630] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.382325] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 in Status: IN_PROGRESS for 2s [ 832.432076] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.432076] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.432076] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.432076] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.432076] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.432076] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4dfff3d-ef74-48f2-8955-b975cccf84d9 is going to be updated. [ 832.470332] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.470332] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.470332] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.470332] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.470332] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.481951] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4dfff3d-ef74-48f2-8955-b975cccf84d9 in Status: IN_PROGRESS for 2s [ 832.647048] env[66502]: INFO networking_nsxv3.common.synchronization [req-7c498577-2324-428a-981c-0bf883cd81e9 req-fce86ca4-c488-4ecc-b6cc-783032e47953 service nova] Enqueued Resource ID: b4dfff3d-ef74-48f2-8955-b975cccf84d9 with Priority: HIGHEST for action security_group_rules [ 832.647282] env[66502]: INFO networking_nsxv3.common.synchronization [req-7c498577-2324-428a-981c-0bf883cd81e9 req-fce86ca4-c488-4ecc-b6cc-783032e47953 service nova] Enqueued Resource ID: b4dfff3d-ef74-48f2-8955-b975cccf84d9 with Priority: HIGHEST for action security_group_members [ 832.647527] env[66502]: INFO networking_nsxv3.common.synchronization [req-7c498577-2324-428a-981c-0bf883cd81e9 req-fce86ca4-c488-4ecc-b6cc-783032e47953 service nova] Enqueued Resource ID: e225da9e-2b6c-428f-becf-f147ff4ffa8e with Priority: HIGHEST for action port [ 832.649215] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4dfff3d-ef74-48f2-8955-b975cccf84d9 with Priority: HIGHEST for action security_group_rules [ 832.649465] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4dfff3d-ef74-48f2-8955-b975cccf84d9 with Priority: HIGHEST for action security_group_members [ 832.649465] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e225da9e-2b6c-428f-becf-f147ff4ffa8e with Priority: HIGHEST for action port [ 832.651105] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4dfff3d-ef74-48f2-8955-b975cccf84d9 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.651105] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.651105] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.651105] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.651105] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4dfff3d-ef74-48f2-8955-b975cccf84d9',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.652190] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4dfff3d-ef74-48f2-8955-b975cccf84d9 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.652363] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.652708] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-e225da9e-2b6c-428f-becf-f147ff4ffa8e taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.652886] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e225da9e-2b6c-428f-becf-f147ff4ffa8e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.652972] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e225da9e-2b6c-428f-becf-f147ff4ffa8e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.653258] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e225da9e-2b6c-428f-becf-f147ff4ffa8e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.653374] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e225da9e-2b6c-428f-becf-f147ff4ffa8e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.916062] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b96da033-21f1-44bb-a822-a4cb59139771 in Status: SUCCESS [ 832.916502] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.086897] env[66502]: INFO networking_nsxv3.common.synchronization [req-4eb4187a-fe63-41b5-abe7-6363fd707059 req-c9824036-098b-424f-a609-4b9f16f342a2 tempest-SecurityGroupRulesTestJSON-1133487754 tempest-SecurityGroupRulesTestJSON-1133487754-project-member] Enqueued Resource ID: eb2056ca-e19e-401f-8a14-67fd0d5b4113 with Priority: HIGHEST for action security_group_rules [ 833.087539] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb2056ca-e19e-401f-8a14-67fd0d5b4113 with Priority: HIGHEST for action security_group_rules [ 833.087838] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb2056ca-e19e-401f-8a14-67fd0d5b4113 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.087955] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb2056ca-e19e-401f-8a14-67fd0d5b4113" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.090019] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb2056ca-e19e-401f-8a14-67fd0d5b4113" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.090019] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb2056ca-e19e-401f-8a14-67fd0d5b4113" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.090019] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb2056ca-e19e-401f-8a14-67fd0d5b4113',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.155944] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4dfff3d-ef74-48f2-8955-b975cccf84d9 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.156171] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.156807] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e225da9e-2b6c-428f-becf-f147ff4ffa8e with status ACTIVE [ 833.157097] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.158221] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.158310] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.158571] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.158682] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.158936] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.159082] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.159147] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.159355] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.159465] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.159692] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.159820] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.159888] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.160138] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.160250] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.160369] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e225da9e-2b6c-428f-becf-f147ff4ffa8e is going to be updated. [ 833.184722] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.184911] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.184984] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.185357] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.185641] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.185918] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e225da9e-2b6c-428f-becf-f147ff4ffa8e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.584103] env[66502]: INFO networking_nsxv3.common.synchronization [req-a28db495-26ed-41fe-b630-e4b8ff2b9552 req-85072894-af0e-4d63-8ac7-d773684f5e06 tempest-SecurityGroupRulesTestJSON-1133487754 tempest-SecurityGroupRulesTestJSON-1133487754-project-member] Enqueued Resource ID: eb2056ca-e19e-401f-8a14-67fd0d5b4113 with Priority: HIGHEST for action security_group_rules [ 833.584829] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb2056ca-e19e-401f-8a14-67fd0d5b4113 with Priority: HIGHEST for action security_group_rules [ 833.588935] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb2056ca-e19e-401f-8a14-67fd0d5b4113 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.588935] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb2056ca-e19e-401f-8a14-67fd0d5b4113" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.618851] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.618977] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.618977] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.619566] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.619566] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.619566] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb2056ca-e19e-401f-8a14-67fd0d5b4113 already deleted. [ 833.619566] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb2056ca-e19e-401f-8a14-67fd0d5b4113" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.620865] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb2056ca-e19e-401f-8a14-67fd0d5b4113" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.620865] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb2056ca-e19e-401f-8a14-67fd0d5b4113" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.620865] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb2056ca-e19e-401f-8a14-67fd0d5b4113',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 833.837128] env[66502]: INFO networking_nsxv3.common.synchronization [req-d65d5e20-a1ab-438a-b8ea-440c26bfc016 req-ebea05b8-94fe-41ca-b436-60046e2d124f tempest-ServerAddressesTestJSON-2031359937 tempest-ServerAddressesTestJSON-2031359937-project-member] Enqueued Resource ID: 0204e1c6-c967-43a4-828f-5c28ecb8f527 with Priority: HIGHEST for action security_group_members [ 833.837128] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0204e1c6-c967-43a4-828f-5c28ecb8f527 with Priority: HIGHEST for action security_group_members [ 833.837437] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0204e1c6-c967-43a4-828f-5c28ecb8f527 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.837561] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0204e1c6-c967-43a4-828f-5c28ecb8f527" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.837621] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0204e1c6-c967-43a4-828f-5c28ecb8f527" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.837831] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0204e1c6-c967-43a4-828f-5c28ecb8f527" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.838058] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 833.838178] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 833.838239] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 833.838391] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 833.838475] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 833.838569] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0204e1c6-c967-43a4-828f-5c28ecb8f527',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.086397] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d in Status: SUCCESS [ 834.087271] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.155034] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.155034] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.155034] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.155034] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.155329] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.155329] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb2056ca-e19e-401f-8a14-67fd0d5b4113 already deleted. [ 834.155329] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb2056ca-e19e-401f-8a14-67fd0d5b4113" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.234985] env[66502]: INFO networking_nsxv3.common.synchronization [req-ca10cdb9-c216-4241-b83c-35d516f7e761 req-afbdc599-9b6f-47fc-bd86-0da1a14da4f9 tempest-SecurityGroupRulesTestJSON-1133487754 tempest-SecurityGroupRulesTestJSON-1133487754-project-member] Enqueued Resource ID: eb2056ca-e19e-401f-8a14-67fd0d5b4113 with Priority: HIGHEST for action security_group_rules [ 834.235569] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb2056ca-e19e-401f-8a14-67fd0d5b4113 with Priority: HIGHEST for action security_group_rules [ 834.235913] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb2056ca-e19e-401f-8a14-67fd0d5b4113 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.236074] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb2056ca-e19e-401f-8a14-67fd0d5b4113" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.236138] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb2056ca-e19e-401f-8a14-67fd0d5b4113" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.236342] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb2056ca-e19e-401f-8a14-67fd0d5b4113" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.236427] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb2056ca-e19e-401f-8a14-67fd0d5b4113',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.342044] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.342044] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.342044] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.342044] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.342044] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.342472] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.342472] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.342970] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.343082] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.343164] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.343259] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0204e1c6-c967-43a4-828f-5c28ecb8f527 is going to be updated. [ 834.387169] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.387385] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.387385] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.388087] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.388087] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.393786] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 in Status: SUCCESS [ 834.394055] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.394233] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.394470] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.394720] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.394844] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.394905] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.395223] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.395303] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.395390] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.395459] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.397251] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0204e1c6-c967-43a4-828f-5c28ecb8f527 in Status: IN_PROGRESS for 2s [ 834.499147] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4dfff3d-ef74-48f2-8955-b975cccf84d9 in Status: SUCCESS [ 834.499147] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.499147] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.499147] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.499147] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.499147] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.499147] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.499147] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.499147] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.499734] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4dfff3d-ef74-48f2-8955-b975cccf84d9',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.757300] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.757499] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.757499] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.757679] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.757762] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.757949] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb2056ca-e19e-401f-8a14-67fd0d5b4113 already deleted. [ 834.757949] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb2056ca-e19e-401f-8a14-67fd0d5b4113" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.900044] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.900044] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.900044] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.900044] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.900044] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.900044] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.900044] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.900044] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.900510] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.900510] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.900510] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.900510] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.900510] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.900686] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.900746] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.900850] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.900955] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.901038] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.901168] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.901206] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.901295] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.002036] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4dfff3d-ef74-48f2-8955-b975cccf84d9',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.385406] env[66502]: INFO networking_nsxv3.common.synchronization [req-332efe55-aa8a-447a-be50-4d9e16bf0960 req-f0ec80c0-4ea3-4153-8066-5dc02ab9176b tempest-SecurityGroupsTestJSON-779026578 tempest-SecurityGroupsTestJSON-779026578-project-member] Enqueued Resource ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d with Priority: HIGHEST for action security_group_members [ 835.386057] env[66502]: INFO networking_nsxv3.common.synchronization [req-332efe55-aa8a-447a-be50-4d9e16bf0960 req-f0ec80c0-4ea3-4153-8066-5dc02ab9176b tempest-SecurityGroupsTestJSON-779026578 tempest-SecurityGroupsTestJSON-779026578-project-member] Enqueued Resource ID: dc23d7c3-5dc4-486e-83b2-d32fa7298233 with Priority: HIGHEST for action security_group_members [ 835.386436] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d with Priority: HIGHEST for action security_group_members [ 835.386685] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc23d7c3-5dc4-486e-83b2-d32fa7298233 with Priority: HIGHEST for action security_group_members [ 835.387142] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.387340] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.387460] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.387789] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.388112] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.388298] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.388414] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.388729] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.388898] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.389094] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.390560] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc23d7c3-5dc4-486e-83b2-d32fa7298233 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.390697] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc23d7c3-5dc4-486e-83b2-d32fa7298233" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.390782] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc23d7c3-5dc4-486e-83b2-d32fa7298233" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.391161] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc23d7c3-5dc4-486e-83b2-d32fa7298233" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.391406] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.391563] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.391667] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.391891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.392056] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.392218] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc23d7c3-5dc4-486e-83b2-d32fa7298233',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.405575] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2: rpc.has_security_group_logging(os_id): False [ 835.430433] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.430827] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.430827] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.430927] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.430962] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.431140] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.431239] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.431296] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.431449] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.431519] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.431717] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.431810] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.431871] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.432219] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.432219] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.432291] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.432353] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.432387] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.432530] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.432601] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.432684] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 is going to be updated. [ 835.437262] env[66502]: INFO networking_nsxv3.common.synchronization [req-332efe55-aa8a-447a-be50-4d9e16bf0960 req-f0ec80c0-4ea3-4153-8066-5dc02ab9176b tempest-SecurityGroupsTestJSON-779026578 tempest-SecurityGroupsTestJSON-779026578-project-member] Enqueued Resource ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d with Priority: HIGHEST for action security_group_rules [ 835.437428] env[66502]: INFO networking_nsxv3.common.synchronization [req-332efe55-aa8a-447a-be50-4d9e16bf0960 req-f0ec80c0-4ea3-4153-8066-5dc02ab9176b tempest-SecurityGroupsTestJSON-779026578 tempest-SecurityGroupsTestJSON-779026578-project-member] Enqueued Resource ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d with Priority: HIGHEST for action security_group_members [ 835.437558] env[66502]: INFO networking_nsxv3.common.synchronization [req-332efe55-aa8a-447a-be50-4d9e16bf0960 req-f0ec80c0-4ea3-4153-8066-5dc02ab9176b tempest-SecurityGroupsTestJSON-779026578 tempest-SecurityGroupsTestJSON-779026578-project-member] Enqueued Resource ID: dc23d7c3-5dc4-486e-83b2-d32fa7298233 with Priority: HIGHEST for action security_group_rules [ 835.437679] env[66502]: INFO networking_nsxv3.common.synchronization [req-332efe55-aa8a-447a-be50-4d9e16bf0960 req-f0ec80c0-4ea3-4153-8066-5dc02ab9176b tempest-SecurityGroupsTestJSON-779026578 tempest-SecurityGroupsTestJSON-779026578-project-member] Enqueued Resource ID: dc23d7c3-5dc4-486e-83b2-d32fa7298233 with Priority: HIGHEST for action security_group_members [ 835.437801] env[66502]: INFO networking_nsxv3.common.synchronization [req-332efe55-aa8a-447a-be50-4d9e16bf0960 req-f0ec80c0-4ea3-4153-8066-5dc02ab9176b tempest-SecurityGroupsTestJSON-779026578 tempest-SecurityGroupsTestJSON-779026578-project-member] Enqueued Resource ID: 2c1b965c-cee0-4b6e-8951-a26c98608cc0 with Priority: HIGHEST for action port [ 835.438313] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d with Priority: HIGHEST for action security_group_rules [ 835.438551] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc23d7c3-5dc4-486e-83b2-d32fa7298233 with Priority: HIGHEST for action security_group_rules [ 835.438551] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c1b965c-cee0-4b6e-8951-a26c98608cc0 with Priority: HIGHEST for action port [ 835.438626] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d with Priority: HIGHEST for action security_group_members [ 835.438715] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc23d7c3-5dc4-486e-83b2-d32fa7298233 with Priority: HIGHEST for action security_group_members [ 835.439044] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e5c2909-7671-4f4c-995e-cc0f19e2e48d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.439103] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.439169] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.439349] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.439428] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.440278] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc23d7c3-5dc4-486e-83b2-d32fa7298233 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.440390] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc23d7c3-5dc4-486e-83b2-d32fa7298233" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.440480] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc23d7c3-5dc4-486e-83b2-d32fa7298233" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.440666] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc23d7c3-5dc4-486e-83b2-d32fa7298233" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.440743] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc23d7c3-5dc4-486e-83b2-d32fa7298233',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.441506] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c1b965c-cee0-4b6e-8951-a26c98608cc0 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.441617] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c1b965c-cee0-4b6e-8951-a26c98608cc0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.441684] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c1b965c-cee0-4b6e-8951-a26c98608cc0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.441838] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c1b965c-cee0-4b6e-8951-a26c98608cc0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.442782] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c1b965c-cee0-4b6e-8951-a26c98608cc0',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.442782] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.442782] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.443231] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc23d7c3-5dc4-486e-83b2-d32fa7298233 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.443231] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc23d7c3-5dc4-486e-83b2-d32fa7298233" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.503040] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.503277] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.503277] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.503515] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.503767] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.504979] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4dfff3d-ef74-48f2-8955-b975cccf84d9',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.519913] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 in Status: IN_PROGRESS for 2s [ 835.895536] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.900939] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc23d7c3-5dc4-486e-83b2-d32fa7298233',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 835.944583] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c1b965c-cee0-4b6e-8951-a26c98608cc0 with status ACTIVE [ 835.945521] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.945521] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.945521] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.946925] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.946925] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.946925] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.946925] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.946925] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.946925] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.946925] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.946925] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.947297] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.947297] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.947297] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.947410] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.947410] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c1b965c-cee0-4b6e-8951-a26c98608cc0 is going to be updated. [ 835.951090] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.951090] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.951717] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc23d7c3-5dc4-486e-83b2-d32fa7298233 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.951876] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc23d7c3-5dc4-486e-83b2-d32fa7298233" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.975870] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 835.976085] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 835.976182] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 835.976390] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 835.976527] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 835.976761] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c1b965c-cee0-4b6e-8951-a26c98608cc0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.007447] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.010637] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.010881] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.011732] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.011869] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.011994] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4dfff3d-ef74-48f2-8955-b975cccf84d9 is going to be updated. [ 836.063530] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.063530] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.063530] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.063530] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.063530] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.072491] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4dfff3d-ef74-48f2-8955-b975cccf84d9 in Status: IN_PROGRESS for 2s [ 836.405861] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.409048] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc23d7c3-5dc4-486e-83b2-d32fa7298233',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.419017] env[66502]: INFO networking_nsxv3.common.synchronization [req-7b3117e9-9220-41f4-b7e8-3e36ea73be84 req-239ec84c-6be7-44dd-954c-8bcddd13a1da tempest-SecurityGroupsTestJSON-779026578 tempest-SecurityGroupsTestJSON-779026578-project-member] Enqueued Resource ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d with Priority: HIGHEST for action security_group_members [ 836.419222] env[66502]: INFO networking_nsxv3.common.synchronization [req-7b3117e9-9220-41f4-b7e8-3e36ea73be84 req-239ec84c-6be7-44dd-954c-8bcddd13a1da tempest-SecurityGroupsTestJSON-779026578 tempest-SecurityGroupsTestJSON-779026578-project-member] Enqueued Resource ID: 4dd503d7-4db7-4af2-b850-79a736ef1ddc with Priority: HIGHEST for action security_group_members [ 836.419351] env[66502]: INFO networking_nsxv3.common.synchronization [req-7b3117e9-9220-41f4-b7e8-3e36ea73be84 req-239ec84c-6be7-44dd-954c-8bcddd13a1da tempest-SecurityGroupsTestJSON-779026578 tempest-SecurityGroupsTestJSON-779026578-project-member] Enqueued Resource ID: dc23d7c3-5dc4-486e-83b2-d32fa7298233 with Priority: HIGHEST for action security_group_members [ 836.420440] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d with Priority: HIGHEST for action security_group_members [ 836.420628] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dd503d7-4db7-4af2-b850-79a736ef1ddc with Priority: HIGHEST for action security_group_members [ 836.420755] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc23d7c3-5dc4-486e-83b2-d32fa7298233 with Priority: HIGHEST for action security_group_members [ 836.421157] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.421298] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.421540] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dd503d7-4db7-4af2-b850-79a736ef1ddc taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.421675] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dd503d7-4db7-4af2-b850-79a736ef1ddc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.421759] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dd503d7-4db7-4af2-b850-79a736ef1ddc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.422090] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dd503d7-4db7-4af2-b850-79a736ef1ddc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.422774] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.422774] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.422774] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.422774] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.422774] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.422774] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4dd503d7-4db7-4af2-b850-79a736ef1ddc',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.424063] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc23d7c3-5dc4-486e-83b2-d32fa7298233 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.424063] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc23d7c3-5dc4-486e-83b2-d32fa7298233" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.424783] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0204e1c6-c967-43a4-828f-5c28ecb8f527 in Status: SUCCESS [ 836.424965] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0204e1c6-c967-43a4-828f-5c28ecb8f527 deletion is rescheduled due to dependency. [ 836.425078] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0204e1c6-c967-43a4-828f-5c28ecb8f527" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.472627] env[66502]: INFO networking_nsxv3.common.synchronization [req-7b3117e9-9220-41f4-b7e8-3e36ea73be84 req-239ec84c-6be7-44dd-954c-8bcddd13a1da tempest-SecurityGroupsTestJSON-779026578 tempest-SecurityGroupsTestJSON-779026578-project-member] Enqueued Resource ID: 4dd503d7-4db7-4af2-b850-79a736ef1ddc with Priority: HIGHEST for action security_group_rules [ 836.472798] env[66502]: INFO networking_nsxv3.common.synchronization [req-7b3117e9-9220-41f4-b7e8-3e36ea73be84 req-239ec84c-6be7-44dd-954c-8bcddd13a1da tempest-SecurityGroupsTestJSON-779026578 tempest-SecurityGroupsTestJSON-779026578-project-member] Enqueued Resource ID: 4dd503d7-4db7-4af2-b850-79a736ef1ddc with Priority: HIGHEST for action security_group_members [ 836.472931] env[66502]: INFO networking_nsxv3.common.synchronization [req-7b3117e9-9220-41f4-b7e8-3e36ea73be84 req-239ec84c-6be7-44dd-954c-8bcddd13a1da tempest-SecurityGroupsTestJSON-779026578 tempest-SecurityGroupsTestJSON-779026578-project-member] Enqueued Resource ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d with Priority: HIGHEST for action security_group_rules [ 836.473065] env[66502]: INFO networking_nsxv3.common.synchronization [req-7b3117e9-9220-41f4-b7e8-3e36ea73be84 req-239ec84c-6be7-44dd-954c-8bcddd13a1da tempest-SecurityGroupsTestJSON-779026578 tempest-SecurityGroupsTestJSON-779026578-project-member] Enqueued Resource ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d with Priority: HIGHEST for action security_group_members [ 836.473187] env[66502]: INFO networking_nsxv3.common.synchronization [req-7b3117e9-9220-41f4-b7e8-3e36ea73be84 req-239ec84c-6be7-44dd-954c-8bcddd13a1da tempest-SecurityGroupsTestJSON-779026578 tempest-SecurityGroupsTestJSON-779026578-project-member] Enqueued Resource ID: dc23d7c3-5dc4-486e-83b2-d32fa7298233 with Priority: HIGHEST for action security_group_rules [ 836.473306] env[66502]: INFO networking_nsxv3.common.synchronization [req-7b3117e9-9220-41f4-b7e8-3e36ea73be84 req-239ec84c-6be7-44dd-954c-8bcddd13a1da tempest-SecurityGroupsTestJSON-779026578 tempest-SecurityGroupsTestJSON-779026578-project-member] Enqueued Resource ID: dc23d7c3-5dc4-486e-83b2-d32fa7298233 with Priority: HIGHEST for action security_group_members [ 836.473428] env[66502]: INFO networking_nsxv3.common.synchronization [req-7b3117e9-9220-41f4-b7e8-3e36ea73be84 req-239ec84c-6be7-44dd-954c-8bcddd13a1da tempest-SecurityGroupsTestJSON-779026578 tempest-SecurityGroupsTestJSON-779026578-project-member] Enqueued Resource ID: 2c1b965c-cee0-4b6e-8951-a26c98608cc0 with Priority: HIGHEST for action port [ 836.473945] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dd503d7-4db7-4af2-b850-79a736ef1ddc with Priority: HIGHEST for action security_group_rules [ 836.474258] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d with Priority: HIGHEST for action security_group_rules [ 836.474378] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc23d7c3-5dc4-486e-83b2-d32fa7298233 with Priority: HIGHEST for action security_group_members [ 836.474503] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c1b965c-cee0-4b6e-8951-a26c98608cc0 with Priority: HIGHEST for action port [ 836.475109] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc23d7c3-5dc4-486e-83b2-d32fa7298233 with Priority: HIGHEST for action security_group_rules [ 836.475109] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dd503d7-4db7-4af2-b850-79a736ef1ddc with Priority: HIGHEST for action security_group_members [ 836.475109] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d with Priority: HIGHEST for action security_group_members [ 836.475109] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4dd503d7-4db7-4af2-b850-79a736ef1ddc taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.475544] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4dd503d7-4db7-4af2-b850-79a736ef1ddc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.475544] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4dd503d7-4db7-4af2-b850-79a736ef1ddc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.475544] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4dd503d7-4db7-4af2-b850-79a736ef1ddc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.475544] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4dd503d7-4db7-4af2-b850-79a736ef1ddc',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.476717] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e5c2909-7671-4f4c-995e-cc0f19e2e48d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.476860] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.477079] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc23d7c3-5dc4-486e-83b2-d32fa7298233 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.477170] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc23d7c3-5dc4-486e-83b2-d32fa7298233" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.477355] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c1b965c-cee0-4b6e-8951-a26c98608cc0 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.477452] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c1b965c-cee0-4b6e-8951-a26c98608cc0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.477507] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c1b965c-cee0-4b6e-8951-a26c98608cc0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.477685] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c1b965c-cee0-4b6e-8951-a26c98608cc0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.477814] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c1b965c-cee0-4b6e-8951-a26c98608cc0',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.479818] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc23d7c3-5dc4-486e-83b2-d32fa7298233 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.479908] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc23d7c3-5dc4-486e-83b2-d32fa7298233" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.480265] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dd503d7-4db7-4af2-b850-79a736ef1ddc taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.480343] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dd503d7-4db7-4af2-b850-79a736ef1ddc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.481411] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.481411] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.911885] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.912062] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.912133] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.912397] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.912447] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.912545] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc23d7c3-5dc4-486e-83b2-d32fa7298233 is going to be created. [ 836.913860] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.914076] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.914076] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.914283] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.915033] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.915033] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d is going to be updated. [ 836.927478] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4dd503d7-4db7-4af2-b850-79a736ef1ddc',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.955213] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.955888] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.955972] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.956202] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.956361] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.958561] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.958681] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.958742] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.958874] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.959010] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.972190] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d in Status: IN_PROGRESS for 2s [ 836.973196] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc23d7c3-5dc4-486e-83b2-d32fa7298233 in Status: UNINITIALIZED for 2s [ 836.982335] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dd503d7-4db7-4af2-b850-79a736ef1ddc taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.982335] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dd503d7-4db7-4af2-b850-79a736ef1ddc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.982570] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c1b965c-cee0-4b6e-8951-a26c98608cc0 with status ACTIVE [ 836.982610] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.983479] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.983479] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.983479] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.983479] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.983479] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.983479] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.983479] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.984078] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.984078] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.984078] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.984078] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.984078] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.984774] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.984947] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.985037] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c1b965c-cee0-4b6e-8951-a26c98608cc0 is going to be updated. [ 837.020729] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.020821] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.020860] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.021101] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.021242] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.021403] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c1b965c-cee0-4b6e-8951-a26c98608cc0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.429867] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4dd503d7-4db7-4af2-b850-79a736ef1ddc',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 837.540950] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 in Status: SUCCESS [ 837.541235] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.933080] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.933231] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.933273] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.933472] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.933554] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.933655] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dd503d7-4db7-4af2-b850-79a736ef1ddc is going to be created. [ 837.959225] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 837.959225] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 837.959225] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 837.959225] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 837.959225] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 837.969301] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dd503d7-4db7-4af2-b850-79a736ef1ddc in Status: UNINITIALIZED for 2s [ 838.085687] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4dfff3d-ef74-48f2-8955-b975cccf84d9 in Status: SUCCESS [ 838.085687] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.085687] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.085915] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.086080] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.086080] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.086196] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.086268] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.086348] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.086669] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.086669] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b4dfff3d-ef74-48f2-8955-b975cccf84d9',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.344627] env[66502]: INFO networking_nsxv3.common.synchronization [req-b540ccd6-a74e-4be6-92ab-c8721ccc1d3c req-a6e2a2f4-6dcd-4c28-ab08-ead6fd945fe0 tempest-AttachVolumeNegativeTest-686526601 tempest-AttachVolumeNegativeTest-686526601-project-member] Enqueued Resource ID: 5988a824-4ff2-477d-8139-5418f9c569e4 with Priority: HIGHEST for action security_group_members [ 838.345862] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5988a824-4ff2-477d-8139-5418f9c569e4 with Priority: HIGHEST for action security_group_members [ 838.345862] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-5988a824-4ff2-477d-8139-5418f9c569e4 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.345862] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5988a824-4ff2-477d-8139-5418f9c569e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.345862] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5988a824-4ff2-477d-8139-5418f9c569e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.346199] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5988a824-4ff2-477d-8139-5418f9c569e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.346247] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.346386] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.346434] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.346592] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.346732] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.346777] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5988a824-4ff2-477d-8139-5418f9c569e4',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.589753] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4dfff3d-ef74-48f2-8955-b975cccf84d9 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.590098] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.590098] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.590271] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.590447] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.590549] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.590613] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.590765] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.590852] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.590940] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.591115] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4dfff3d-ef74-48f2-8955-b975cccf84d9 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.591208] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.591269] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.591410] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.591545] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.591636] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.591696] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.591830] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.591905] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.592067] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.592260] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b4dfff3d-ef74-48f2-8955-b975cccf84d9',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.821700] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-647 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.821700] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-647" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.821700] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-647" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.821700] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-647" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.821700] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.821700] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.821700] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.821700] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.822290] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.822536] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 838.822924] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 838.823714] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 838.824383] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 838.824383] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 838.825100] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 838.825331] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 838.849727] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.849727] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.849727] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.849727] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.850101] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.850878] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.850878] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.850878] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.850878] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.851197] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.851547] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5988a824-4ff2-477d-8139-5418f9c569e4 already deleted. [ 838.851547] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5988a824-4ff2-477d-8139-5418f9c569e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.852750] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 838.852935] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 838.853210] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 838.853522] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-647" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.854249] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-c9513fa9-0d5f-44c7-9886-064a0b30015d taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.854467] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-c9513fa9-0d5f-44c7-9886-064a0b30015d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.854590] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-c9513fa9-0d5f-44c7-9886-064a0b30015d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.854922] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-c9513fa9-0d5f-44c7-9886-064a0b30015d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.855164] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9513fa9-0d5f-44c7-9886-064a0b30015d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.987919] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d in Status: SUCCESS [ 838.988082] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.988270] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.988640] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.989362] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.989362] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.989362] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.989362] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.989604] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.989680] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.991701] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc23d7c3-5dc4-486e-83b2-d32fa7298233 in Status: SUCCESS [ 838.991896] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc23d7c3-5dc4-486e-83b2-d32fa7298233" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.992336] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc23d7c3-5dc4-486e-83b2-d32fa7298233" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.992647] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc23d7c3-5dc4-486e-83b2-d32fa7298233" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.992849] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.992966] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.993117] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.993381] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.993381] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.993492] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc23d7c3-5dc4-486e-83b2-d32fa7298233',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.095150] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b4dfff3d-ef74-48f2-8955-b975cccf84d9: rpc.has_security_group_logging(os_id): False [ 839.120604] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.120754] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.120754] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.120980] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.148589] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.150891] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.150891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.150891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.150891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.150891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.150891] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.150891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.150891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.150891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.150891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.152222] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.152222] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.152222] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.152222] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.152222] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.152222] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4dfff3d-ef74-48f2-8955-b975cccf84d9 is going to be updated. [ 839.219544] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.219751] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.219751] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.219970] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.220132] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.237169] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4dfff3d-ef74-48f2-8955-b975cccf84d9 in Status: IN_PROGRESS for 2s [ 839.358061] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.358468] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.358600] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.358948] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.359149] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.359331] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port c9513fa9-0d5f-44c7-9886-064a0b30015d not found, creating... [ 839.359659] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.359865] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.360071] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.360329] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.360510] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.360976] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.361170] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.361292] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.361538] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.361889] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.361889] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: c9513fa9-0d5f-44c7-9886-064a0b30015d is going to be created. [ 839.385060] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.385307] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.385421] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.385694] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.386051] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.386286] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-c9513fa9-0d5f-44c7-9886-064a0b30015d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.495966] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.499047] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc23d7c3-5dc4-486e-83b2-d32fa7298233',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.817528] env[66502]: INFO networking_nsxv3.common.synchronization [req-0bb15d11-11ce-49c0-8724-d710a7ac81c5 req-33206459-e8e3-4e4f-9000-91c340de5dcf tempest-ImagesOneServerNegativeTestJSON-1621881971 tempest-ImagesOneServerNegativeTestJSON-1621881971-project-member] Enqueued Resource ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 with Priority: HIGHEST for action security_group_members [ 839.819201] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 with Priority: HIGHEST for action security_group_members [ 839.819201] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.819201] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.819201] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.819201] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.819201] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.819201] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.819201] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.819201] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.819902] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.819902] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ddb3b9a8-c63d-4123-aa7f-cbf2b5279231',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.979857] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dd503d7-4db7-4af2-b850-79a736ef1ddc in Status: SUCCESS [ 839.980325] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dd503d7-4db7-4af2-b850-79a736ef1ddc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.980325] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dd503d7-4db7-4af2-b850-79a736ef1ddc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.980471] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dd503d7-4db7-4af2-b850-79a736ef1ddc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.982260] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.982260] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.982260] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.982260] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.982260] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.982260] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4dd503d7-4db7-4af2-b850-79a736ef1ddc',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.999191] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.000519] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc23d7c3-5dc4-486e-83b2-d32fa7298233',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.169149] env[66502]: INFO networking_nsxv3.common.synchronization [req-b540ccd6-a74e-4be6-92ab-c8721ccc1d3c req-435123bc-6454-4ecb-8ea7-16a480a2ded2 service nova] Enqueued Resource ID: 5988a824-4ff2-477d-8139-5418f9c569e4 with Priority: HIGHEST for action security_group_rules [ 840.169341] env[66502]: INFO networking_nsxv3.common.synchronization [req-b540ccd6-a74e-4be6-92ab-c8721ccc1d3c req-435123bc-6454-4ecb-8ea7-16a480a2ded2 service nova] Enqueued Resource ID: 5988a824-4ff2-477d-8139-5418f9c569e4 with Priority: HIGHEST for action security_group_members [ 840.169477] env[66502]: INFO networking_nsxv3.common.synchronization [req-b540ccd6-a74e-4be6-92ab-c8721ccc1d3c req-435123bc-6454-4ecb-8ea7-16a480a2ded2 service nova] Enqueued Resource ID: c9513fa9-0d5f-44c7-9886-064a0b30015d with Priority: HIGHEST for action port [ 840.170049] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5988a824-4ff2-477d-8139-5418f9c569e4 with Priority: HIGHEST for action security_group_rules [ 840.170190] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5988a824-4ff2-477d-8139-5418f9c569e4 with Priority: HIGHEST for action security_group_members [ 840.170290] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c9513fa9-0d5f-44c7-9886-064a0b30015d with Priority: HIGHEST for action port [ 840.170638] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5988a824-4ff2-477d-8139-5418f9c569e4 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.170715] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5988a824-4ff2-477d-8139-5418f9c569e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.170816] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5988a824-4ff2-477d-8139-5418f9c569e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.171117] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5988a824-4ff2-477d-8139-5418f9c569e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.171244] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5988a824-4ff2-477d-8139-5418f9c569e4',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.173057] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-5988a824-4ff2-477d-8139-5418f9c569e4 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.173239] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5988a824-4ff2-477d-8139-5418f9c569e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.173350] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5988a824-4ff2-477d-8139-5418f9c569e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.173621] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5988a824-4ff2-477d-8139-5418f9c569e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.173867] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.174207] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.174367] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.174693] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.174834] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.174977] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5988a824-4ff2-477d-8139-5418f9c569e4',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.176718] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-c9513fa9-0d5f-44c7-9886-064a0b30015d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.176908] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c9513fa9-0d5f-44c7-9886-064a0b30015d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.177035] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c9513fa9-0d5f-44c7-9886-064a0b30015d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.177451] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c9513fa9-0d5f-44c7-9886-064a0b30015d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.177451] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c9513fa9-0d5f-44c7-9886-064a0b30015d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.321579] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.321683] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.321772] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.322042] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.322086] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.322283] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.322385] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.322447] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.322604] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.322681] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.322769] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 is going to be updated. [ 840.351620] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.351801] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.351864] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.352110] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.352269] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.363542] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 in Status: IN_PROGRESS for 2s [ 840.486598] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4dd503d7-4db7-4af2-b850-79a736ef1ddc',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.502942] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.503071] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.504420] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.504420] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.504420] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.504420] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d is going to be updated. [ 840.505437] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.505599] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.505688] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.505935] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.506113] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.506171] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc23d7c3-5dc4-486e-83b2-d32fa7298233 is going to be updated. [ 840.534076] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.534365] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.534365] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.534503] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.534623] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.536914] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.537149] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.537231] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.537419] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.538259] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.550489] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc23d7c3-5dc4-486e-83b2-d32fa7298233 in Status: IN_PROGRESS for 2s [ 840.551265] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d in Status: IN_PROGRESS for 2s [ 840.674048] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-5988a824-4ff2-477d-8139-5418f9c569e4 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.675017] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5988a824-4ff2-477d-8139-5418f9c569e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.677384] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5988a824-4ff2-477d-8139-5418f9c569e4',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.680170] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c9513fa9-0d5f-44c7-9886-064a0b30015d with status ACTIVE [ 840.680652] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.680652] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.680652] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.680866] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.681096] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.681689] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.681689] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.681689] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.681689] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.681689] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.682029] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.682029] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.682029] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.682029] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.682477] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.682477] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c9513fa9-0d5f-44c7-9886-064a0b30015d is going to be updated. [ 840.706761] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.706761] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.706761] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.706761] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.706761] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.706761] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c9513fa9-0d5f-44c7-9886-064a0b30015d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.989543] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4dd503d7-4db7-4af2-b850-79a736ef1ddc',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.155341] env[66502]: INFO networking_nsxv3.common.synchronization [req-aeb1afac-05cb-42c2-8927-a73fb6b44dfd req-ac84bf83-3ba2-4f23-bd15-2c0730247d15 tempest-ServersAdminTestJSON-292997046 tempest-ServersAdminTestJSON-292997046-project-member] Enqueued Resource ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 with Priority: HIGHEST for action security_group_members [ 841.155901] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 with Priority: HIGHEST for action security_group_members [ 841.156229] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.156349] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.156418] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.156609] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.156867] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.156867] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.157111] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.157111] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.157211] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.157211] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.179513] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5988a824-4ff2-477d-8139-5418f9c569e4',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.254469] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b4dfff3d-ef74-48f2-8955-b975cccf84d9 in Status: SUCCESS [ 841.255284] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.492338] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.492838] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.492925] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.493171] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.493269] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.493380] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dd503d7-4db7-4af2-b850-79a736ef1ddc is going to be updated. [ 841.522289] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.522461] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.522503] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.522711] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.522852] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.531965] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dd503d7-4db7-4af2-b850-79a736ef1ddc in Status: IN_PROGRESS for 2s [ 841.583148] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-8 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.583363] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.583499] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.583734] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.583981] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.584336] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.584460] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.584697] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.584841] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.585066] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 841.585183] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 841.585287] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 841.585400] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 841.585490] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 841.585592] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 841.585718] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 841.615325] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 841.615535] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 841.615597] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 841.615842] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.616207] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-7c470bb3-202b-4900-9569-372c7c36d94b taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.616380] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-7c470bb3-202b-4900-9569-372c7c36d94b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.616499] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-7c470bb3-202b-4900-9569-372c7c36d94b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.616848] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-7c470bb3-202b-4900-9569-372c7c36d94b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.616989] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c470bb3-202b-4900-9569-372c7c36d94b',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.659247] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.682840] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.682840] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.682840] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.682840] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.682840] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.682840] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5988a824-4ff2-477d-8139-5418f9c569e4 is going to be created. [ 841.710619] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.710800] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.710851] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.711219] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.711957] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.722822] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5988a824-4ff2-477d-8139-5418f9c569e4 in Status: UNINITIALIZED for 2s [ 842.121741] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.122122] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.122122] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.122472] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.122645] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.122802] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port 7c470bb3-202b-4900-9569-372c7c36d94b not found, creating... [ 842.123075] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.123233] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.123348] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.123569] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.123719] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.124041] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.124232] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.124371] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.124589] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.124725] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.124869] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: 7c470bb3-202b-4900-9569-372c7c36d94b is going to be created. [ 842.146631] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.146921] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.147070] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.147351] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.147572] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.147791] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-7c470bb3-202b-4900-9569-372c7c36d94b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.161781] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.356038] env[66502]: INFO networking_nsxv3.common.synchronization [None req-fa9f4fb5-d6d2-47ff-9362-e4ae893522ef None None] Enqueued Resource ID: 8df82548-d62b-4e6c-9c8f-ad58c2ce99ce with Priority: HIGHEST for action port [ 842.356254] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8df82548-d62b-4e6c-9c8f-ad58c2ce99ce with Priority: HIGHEST for action port [ 842.356492] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-8df82548-d62b-4e6c-9c8f-ad58c2ce99ce taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.356492] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8df82548-d62b-4e6c-9c8f-ad58c2ce99ce" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.356654] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8df82548-d62b-4e6c-9c8f-ad58c2ce99ce" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.356859] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8df82548-d62b-4e6c-9c8f-ad58c2ce99ce" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.356963] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8df82548-d62b-4e6c-9c8f-ad58c2ce99ce',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.377465] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 in Status: SUCCESS [ 842.377715] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 deletion is rescheduled due to dependency. [ 842.377783] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.562320] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc23d7c3-5dc4-486e-83b2-d32fa7298233 in Status: SUCCESS [ 842.562657] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc23d7c3-5dc4-486e-83b2-d32fa7298233" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.562846] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc23d7c3-5dc4-486e-83b2-d32fa7298233" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.563103] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc23d7c3-5dc4-486e-83b2-d32fa7298233" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.563316] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.563447] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.563494] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.563652] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.563730] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.563831] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc23d7c3-5dc4-486e-83b2-d32fa7298233" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.563924] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dc23d7c3-5dc4-486e-83b2-d32fa7298233',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.565675] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d in Status: SUCCESS [ 842.565888] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.566253] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc23d7c3-5dc4-486e-83b2-d32fa7298233" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.566419] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc23d7c3-5dc4-486e-83b2-d32fa7298233" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.566578] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.566686] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.566749] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.566929] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.567037] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.567132] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc23d7c3-5dc4-486e-83b2-d32fa7298233',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.567835] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.568013] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.568534] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.568638] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.568716] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.568878] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.568958] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.569058] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.569170] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.570049] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.570132] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.570289] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.570387] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.570451] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.570590] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.570666] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.570749] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.664943] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.665186] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.665274] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.665496] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.665856] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.665856] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 is going to be updated. [ 842.704531] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.704531] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.704767] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.704930] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.705310] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.716602] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 in Status: IN_PROGRESS for 2s [ 842.854130] env[66502]: INFO networking_nsxv3.common.synchronization [req-aeb1afac-05cb-42c2-8927-a73fb6b44dfd req-f9630abf-bd1f-4aac-9087-7e924ec3396d service nova] Enqueued Resource ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 with Priority: HIGHEST for action security_group_rules [ 842.854130] env[66502]: INFO networking_nsxv3.common.synchronization [req-aeb1afac-05cb-42c2-8927-a73fb6b44dfd req-f9630abf-bd1f-4aac-9087-7e924ec3396d service nova] Enqueued Resource ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 with Priority: HIGHEST for action security_group_members [ 842.854130] env[66502]: INFO networking_nsxv3.common.synchronization [req-aeb1afac-05cb-42c2-8927-a73fb6b44dfd req-f9630abf-bd1f-4aac-9087-7e924ec3396d service nova] Enqueued Resource ID: 7c470bb3-202b-4900-9569-372c7c36d94b with Priority: HIGHEST for action port [ 842.854443] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 with Priority: HIGHEST for action security_group_rules [ 842.858397] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 with Priority: HIGHEST for action security_group_members [ 842.858397] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c470bb3-202b-4900-9569-372c7c36d94b with Priority: HIGHEST for action port [ 842.858397] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee2e9577-19ff-440d-9bd8-24dbaf88ea24 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.858397] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.858397] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.858397] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.858397] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.858397] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.858397] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.858397] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c470bb3-202b-4900-9569-372c7c36d94b taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.858397] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c470bb3-202b-4900-9569-372c7c36d94b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.858397] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c470bb3-202b-4900-9569-372c7c36d94b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.858397] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c470bb3-202b-4900-9569-372c7c36d94b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.859472] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c470bb3-202b-4900-9569-372c7c36d94b',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 842.862987] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8df82548-d62b-4e6c-9c8f-ad58c2ce99ce [ 842.862987] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.862987] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.862987] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.862987] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.862987] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.862987] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8df82548-d62b-4e6c-9c8f-ad58c2ce99ce already deleted. [ 842.862987] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8df82548-d62b-4e6c-9c8f-ad58c2ce99ce" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.067793] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dc23d7c3-5dc4-486e-83b2-d32fa7298233',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.071583] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc23d7c3-5dc4-486e-83b2-d32fa7298233',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.072528] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.072689] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.072786] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.364165] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.364647] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.365714] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7c470bb3-202b-4900-9569-372c7c36d94b with status ACTIVE [ 843.366197] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.366495] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.366495] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.367198] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.367557] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.367713] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.368376] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.368376] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.368376] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.368516] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.368821] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.368910] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.368989] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.369229] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.369326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.369436] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7c470bb3-202b-4900-9569-372c7c36d94b is going to be updated. [ 843.398252] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.398469] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.398469] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.398615] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.398749] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.398946] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c470bb3-202b-4900-9569-372c7c36d94b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.546928] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dd503d7-4db7-4af2-b850-79a736ef1ddc in Status: SUCCESS [ 843.547143] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dd503d7-4db7-4af2-b850-79a736ef1ddc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.547318] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dd503d7-4db7-4af2-b850-79a736ef1ddc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.547552] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dd503d7-4db7-4af2-b850-79a736ef1ddc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.547748] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.547867] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.547938] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.548088] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.548162] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.548244] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dd503d7-4db7-4af2-b850-79a736ef1ddc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.548332] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4dd503d7-4db7-4af2-b850-79a736ef1ddc',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.573512] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dc23d7c3-5dc4-486e-83b2-d32fa7298233: rpc.has_security_group_logging(os_id): False [ 843.576107] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc23d7c3-5dc4-486e-83b2-d32fa7298233',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.577906] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.599703] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.599955] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.600056] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.600552] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.600552] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.600829] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.600956] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.601035] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.601221] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.601308] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.601371] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc23d7c3-5dc4-486e-83b2-d32fa7298233 is going to be created. [ 843.671522] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.671695] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.671766] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.671999] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.672195] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.689171] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc23d7c3-5dc4-486e-83b2-d32fa7298233 in Status: IN_PROGRESS for 2s [ 843.744903] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5988a824-4ff2-477d-8139-5418f9c569e4 in Status: SUCCESS [ 843.745285] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5988a824-4ff2-477d-8139-5418f9c569e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.745552] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5988a824-4ff2-477d-8139-5418f9c569e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.745894] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5988a824-4ff2-477d-8139-5418f9c569e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.746204] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.746662] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.746662] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.746744] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.746862] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.746992] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5988a824-4ff2-477d-8139-5418f9c569e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.751556] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5988a824-4ff2-477d-8139-5418f9c569e4',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.051051] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4dd503d7-4db7-4af2-b850-79a736ef1ddc',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.081064] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.081206] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.081332] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.081494] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.081590] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.081840] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc23d7c3-5dc4-486e-83b2-d32fa7298233 is going to be updated. [ 844.083690] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.083837] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.083907] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.084279] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.084432] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.084480] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d is going to be updated. [ 844.136055] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.136055] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.136055] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.136055] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.136729] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.139389] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.139544] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.139593] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.140780] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.140780] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.156105] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc23d7c3-5dc4-486e-83b2-d32fa7298233 in Status: IN_PROGRESS for 2s [ 844.156957] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d in Status: IN_PROGRESS for 2s [ 844.191062] env[66502]: INFO networking_nsxv3.common.synchronization [None req-ab2a040c-6b84-4122-afc6-3b2fd94670ed tempest-AttachInterfacesUnderV243Test-1353172127 tempest-AttachInterfacesUnderV243Test-1353172127-project-member] Enqueued Resource ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 with Priority: HIGHEST for action security_group_rules [ 844.191062] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 with Priority: HIGHEST for action security_group_rules [ 844.191062] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2728c2e7-59ab-4cf2-bc7c-4c079064da76 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.191303] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.191303] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.192032] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.192032] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2728c2e7-59ab-4cf2-bc7c-4c079064da76',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.253546] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5988a824-4ff2-477d-8139-5418f9c569e4',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.365409] env[66502]: INFO networking_nsxv3.common.synchronization [None req-f010b916-4a78-4909-a9e6-fd9f24a3f20c tempest-AttachInterfacesUnderV243Test-1353172127 tempest-AttachInterfacesUnderV243Test-1353172127-project-member] Enqueued Resource ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 with Priority: HIGHEST for action security_group_rules [ 844.365989] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 with Priority: HIGHEST for action security_group_rules [ 844.366343] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2728c2e7-59ab-4cf2-bc7c-4c079064da76 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.366647] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.553047] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4dd503d7-4db7-4af2-b850-79a736ef1ddc: rpc.has_security_group_logging(os_id): False [ 844.574853] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.574853] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.574853] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.574853] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.574853] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.574853] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.574853] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.574853] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.574853] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.574853] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.574853] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4dd503d7-4db7-4af2-b850-79a736ef1ddc is going to be created. [ 844.641265] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.641265] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.641265] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.641265] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.641265] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.652194] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4dd503d7-4db7-4af2-b850-79a736ef1ddc in Status: IN_PROGRESS for 2s [ 844.715502] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.715710] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.715960] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.716029] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.716121] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.716219] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 already deleted. [ 844.716345] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.716450] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.716727] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.716727] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2728c2e7-59ab-4cf2-bc7c-4c079064da76',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.729702] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 in Status: SUCCESS [ 844.729702] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.729702] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.729702] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.729702] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.729702] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.729702] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.729702] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.729702] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.729702] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.758399] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5988a824-4ff2-477d-8139-5418f9c569e4: rpc.has_security_group_logging(os_id): False [ 844.780574] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.780574] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.780574] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.780574] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.780574] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.780574] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.780574] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.780574] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.780574] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.780574] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.780574] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5988a824-4ff2-477d-8139-5418f9c569e4 is going to be created. [ 844.847380] env[66502]: INFO networking_nsxv3.common.synchronization [None req-a0945870-e8d9-447f-b9aa-708679202ff4 None None] Enqueued Resource ID: 87925714-ca64-4ebf-a266-649e3f3c47ed with Priority: HIGHEST for action port [ 844.848203] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87925714-ca64-4ebf-a266-649e3f3c47ed with Priority: HIGHEST for action port [ 844.850021] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.850332] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.850581] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.851775] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.851775] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.852654] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-87925714-ca64-4ebf-a266-649e3f3c47ed taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.852829] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-87925714-ca64-4ebf-a266-649e3f3c47ed" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.852901] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-87925714-ca64-4ebf-a266-649e3f3c47ed" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.853683] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-87925714-ca64-4ebf-a266-649e3f3c47ed" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.853845] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87925714-ca64-4ebf-a266-649e3f3c47ed',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.867971] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5988a824-4ff2-477d-8139-5418f9c569e4 in Status: IN_PROGRESS for 2s [ 845.232016] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.238320] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.238462] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.238528] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.239058] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.239159] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.239263] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 already deleted. [ 845.239376] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.358610] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 87925714-ca64-4ebf-a266-649e3f3c47ed [ 845.358749] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.358889] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.358960] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.359202] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.359292] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.359387] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:87925714-ca64-4ebf-a266-649e3f3c47ed already deleted. [ 845.359467] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-87925714-ca64-4ebf-a266-649e3f3c47ed" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.707289] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc23d7c3-5dc4-486e-83b2-d32fa7298233 in Status: SUCCESS [ 845.708754] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc23d7c3-5dc4-486e-83b2-d32fa7298233" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.708950] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc23d7c3-5dc4-486e-83b2-d32fa7298233" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.709207] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc23d7c3-5dc4-486e-83b2-d32fa7298233" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.709301] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc23d7c3-5dc4-486e-83b2-d32fa7298233',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.736474] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.172711] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc23d7c3-5dc4-486e-83b2-d32fa7298233 in Status: SUCCESS [ 846.172711] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc23d7c3-5dc4-486e-83b2-d32fa7298233" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.173392] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d in Status: SUCCESS [ 846.173657] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.173878] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc23d7c3-5dc4-486e-83b2-d32fa7298233" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.174179] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc23d7c3-5dc4-486e-83b2-d32fa7298233" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.174489] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.174648] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.174742] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.174966] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.175075] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.175197] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc23d7c3-5dc4-486e-83b2-d32fa7298233',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.176271] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.176452] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.176642] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.177158] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.177263] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.177453] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.177572] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.178287] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.216258] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc23d7c3-5dc4-486e-83b2-d32fa7298233 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.216258] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc23d7c3-5dc4-486e-83b2-d32fa7298233" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.242797] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.242980] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.243076] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.243406] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.243512] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.243839] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 is going to be updated. [ 846.282478] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.282635] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.282694] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.282936] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.283137] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.295433] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 in Status: IN_PROGRESS for 2s [ 846.671960] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4dd503d7-4db7-4af2-b850-79a736ef1ddc in Status: SUCCESS [ 846.672196] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4dd503d7-4db7-4af2-b850-79a736ef1ddc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.685373] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('dc23d7c3-5dc4-486e-83b2-d32fa7298233',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.686769] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.886211] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5988a824-4ff2-477d-8139-5418f9c569e4 in Status: SUCCESS [ 846.886636] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5988a824-4ff2-477d-8139-5418f9c569e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.188667] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('dc23d7c3-5dc4-486e-83b2-d32fa7298233',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.190899] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.694337] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.694549] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.694549] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.694782] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.694871] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.694971] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc23d7c3-5dc4-486e-83b2-d32fa7298233 is going to be updated. [ 847.696354] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.696492] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.696532] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.696771] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.696771] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.696872] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d is going to be updated. [ 847.730534] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.734065] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.734263] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.734515] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.734891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.737383] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.737530] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.737653] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.737954] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.738055] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.749342] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc23d7c3-5dc4-486e-83b2-d32fa7298233 in Status: IN_PROGRESS for 2s [ 847.751405] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d in Status: IN_PROGRESS for 2s [ 848.307289] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 in Status: SUCCESS [ 848.307705] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.307783] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.307966] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.309135] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.309135] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.309135] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.309135] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.309135] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.309135] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.309135] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.812158] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.812350] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.812444] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.812839] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.812839] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.813104] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.813104] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.813262] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.813262] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.813409] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.813581] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.813708] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.813809] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.814202] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.814362] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.814499] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.814586] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.814760] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.815207] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.815207] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.815207] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.321607] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ee2e9577-19ff-440d-9bd8-24dbaf88ea24: rpc.has_security_group_logging(os_id): False [ 849.340720] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.340918] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.340918] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.341196] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.341284] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.341509] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.341607] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.341680] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.342445] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.342445] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.342445] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.342445] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.342445] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.342445] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.342754] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.342754] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.342754] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.342888] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.343523] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.343758] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.343832] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 is going to be updated. [ 849.432405] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.432550] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.433150] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.433150] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.433150] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.477752] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 in Status: IN_PROGRESS for 2s [ 849.762697] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc23d7c3-5dc4-486e-83b2-d32fa7298233 in Status: SUCCESS [ 849.763033] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc23d7c3-5dc4-486e-83b2-d32fa7298233" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.763260] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc23d7c3-5dc4-486e-83b2-d32fa7298233" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.763495] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc23d7c3-5dc4-486e-83b2-d32fa7298233" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.763846] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.764027] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.764081] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.764247] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.764335] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.764447] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc23d7c3-5dc4-486e-83b2-d32fa7298233" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.764525] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('dc23d7c3-5dc4-486e-83b2-d32fa7298233',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.766321] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d in Status: SUCCESS [ 849.766696] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.766892] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.767418] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.767855] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.768039] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.768284] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.768459] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.768544] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.768661] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.768838] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.769038] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.769077] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.769316] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.769485] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.769679] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.769679] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.769812] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.770201] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.770201] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.770201] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.849467] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 849.849467] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=4 [ 850.272917] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('dc23d7c3-5dc4-486e-83b2-d32fa7298233',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.274116] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e5c2909-7671-4f4c-995e-cc0f19e2e48d: rpc.has_security_group_logging(os_id): False [ 850.297312] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.299052] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.299052] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.299052] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.299052] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.299052] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.299052] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.299052] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.299052] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.299052] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.299052] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.299052] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.299052] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.299052] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.299698] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.299698] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.299698] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.299698] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.299698] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.299698] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.299959] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d is going to be updated. [ 850.371610] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.372042] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.372042] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.373026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.373026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.386618] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d in Status: IN_PROGRESS for 2s [ 850.534545] env[66502]: INFO networking_nsxv3.common.synchronization [req-0b7c2d94-e05e-4fe1-9037-90ed68864c37 req-64e01007-61d1-4451-82ad-7a5412f239d7 tempest-ServerDiskConfigTestJSON-940033598 tempest-ServerDiskConfigTestJSON-940033598-project-member] Enqueued Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGHEST for action security_group_members [ 850.535141] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGHEST for action security_group_members [ 850.535462] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-aba51398-48dc-4f5e-b3cf-1da4130d58fb taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.535580] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.536165] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.536165] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.536165] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.537419] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.537497] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.537649] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.537736] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.537836] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.778105] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for dc23d7c3-5dc4-486e-83b2-d32fa7298233: rpc.has_security_group_logging(os_id): False [ 850.798337] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.798574] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.798574] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.798830] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.798929] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.799189] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.799291] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.799354] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.799506] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.799581] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.799672] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc23d7c3-5dc4-486e-83b2-d32fa7298233 is going to be updated. [ 850.872577] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.872577] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.872577] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.872577] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.872577] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.884030] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc23d7c3-5dc4-486e-83b2-d32fa7298233 in Status: IN_PROGRESS for 2s [ 850.888027] env[66502]: INFO networking_nsxv3.common.synchronization [req-56152b86-fcb8-4fba-b0e1-6043415adaa2 req-575910d0-9c4f-4da8-b849-7bfc4ba974b0 tempest-ServersTestJSON-1210226259 tempest-ServersTestJSON-1210226259-project-member] Enqueued Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_members [ 850.888633] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_members [ 850.892995] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.893242] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.893348] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.893691] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.893928] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.894085] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.894239] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.894463] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.894601] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.894752] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.042957] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.043634] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.043634] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.043634] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.043634] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.043938] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.043938] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.043938] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.044173] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.044173] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.044173] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb is going to be updated. [ 851.075659] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.075811] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.077056] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.077056] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.077056] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.097641] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb in Status: IN_PROGRESS for 2s [ 851.308140] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-708 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.308140] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-708" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.308405] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-708" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.308503] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-708" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.312189] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.312345] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.312468] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.312817] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.312980] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.313211] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 851.313324] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 851.313433] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 851.313539] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 851.313647] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 851.313751] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 851.313950] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 851.348293] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 851.348399] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 851.348538] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 851.348966] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-708" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.349068] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-6d15a8ee-3b86-443e-9f91-f5a602c022a3 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.349205] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-6d15a8ee-3b86-443e-9f91-f5a602c022a3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.349323] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-6d15a8ee-3b86-443e-9f91-f5a602c022a3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.349692] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-6d15a8ee-3b86-443e-9f91-f5a602c022a3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.349834] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d15a8ee-3b86-443e-9f91-f5a602c022a3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.396922] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.496189] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 in Status: SUCCESS [ 851.497245] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.852754] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.853058] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.853218] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.853542] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.853786] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.853934] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 6d15a8ee-3b86-443e-9f91-f5a602c022a3 not found, creating... [ 851.854284] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.854477] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.854624] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.854906] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.855176] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.855561] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.855680] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.855811] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.856154] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.856358] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.856555] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 6d15a8ee-3b86-443e-9f91-f5a602c022a3 is going to be created. [ 851.884077] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.884424] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.884618] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.885111] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.885579] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.885998] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-6d15a8ee-3b86-443e-9f91-f5a602c022a3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.900782] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.403074] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d in Status: SUCCESS [ 852.403351] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.406043] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.406043] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.406043] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.406043] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.406043] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.406043] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d226a97-2d69-4706-b98b-565700008c6f is going to be updated. [ 852.406043] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.406043] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.406043] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.439844] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.439979] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.440060] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.440271] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.440411] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.454883] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: IN_PROGRESS for 2s [ 852.591039] env[66502]: INFO networking_nsxv3.common.synchronization [req-56152b86-fcb8-4fba-b0e1-6043415adaa2 req-222118c2-1627-4675-9072-064e69a49033 service nova] Enqueued Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_rules [ 852.591232] env[66502]: INFO networking_nsxv3.common.synchronization [req-56152b86-fcb8-4fba-b0e1-6043415adaa2 req-222118c2-1627-4675-9072-064e69a49033 service nova] Enqueued Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_members [ 852.591375] env[66502]: INFO networking_nsxv3.common.synchronization [req-56152b86-fcb8-4fba-b0e1-6043415adaa2 req-222118c2-1627-4675-9072-064e69a49033 service nova] Enqueued Resource ID: 6d15a8ee-3b86-443e-9f91-f5a602c022a3 with Priority: HIGHEST for action port [ 852.591872] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_rules [ 852.592009] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_members [ 852.592112] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d15a8ee-3b86-443e-9f91-f5a602c022a3 with Priority: HIGHEST for action port [ 852.592384] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.592541] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.592646] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.592747] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.592826] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.594640] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.594867] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.595111] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d15a8ee-3b86-443e-9f91-f5a602c022a3 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.595217] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d15a8ee-3b86-443e-9f91-f5a602c022a3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.596954] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d15a8ee-3b86-443e-9f91-f5a602c022a3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.596954] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d15a8ee-3b86-443e-9f91-f5a602c022a3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.596954] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d15a8ee-3b86-443e-9f91-f5a602c022a3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.909062] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.909240] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.909395] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.909594] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.909889] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.909889] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.910051] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.910175] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.910263] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.910351] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.910441] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.914014] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: dc23d7c3-5dc4-486e-83b2-d32fa7298233 in Status: SUCCESS [ 852.914014] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc23d7c3-5dc4-486e-83b2-d32fa7298233" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.096162] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.096590] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.098684] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6d15a8ee-3b86-443e-9f91-f5a602c022a3 with status ACTIVE [ 853.098895] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.099058] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.099097] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.099303] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.099416] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.099573] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.099675] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.099734] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.099884] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.099961] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.100155] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.100768] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.100768] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.100768] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.100768] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.100768] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6d15a8ee-3b86-443e-9f91-f5a602c022a3 is going to be updated. [ 853.114882] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb in Status: SUCCESS [ 853.115152] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb deletion is rescheduled due to dependency. [ 853.115252] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.136899] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.136899] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.136899] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.136899] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.136899] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.136899] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d15a8ee-3b86-443e-9f91-f5a602c022a3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.414036] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.414036] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.414036] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.414449] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.414449] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.415459] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.415584] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.415806] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.415989] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.416318] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.417888] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.417888] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.417888] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.418232] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.418500] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.418650] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.418765] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.419022] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.419165] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.419294] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.419447] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.924023] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e5c2909-7671-4f4c-995e-cc0f19e2e48d: rpc.has_security_group_logging(os_id): False [ 853.943453] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.943635] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.943706] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.943890] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.943982] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.944233] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.944325] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.944389] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.944540] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.944617] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.944793] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.944888] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.944947] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.945441] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.945441] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.945441] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.945441] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.945769] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.945769] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.945769] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.945769] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d is going to be updated. [ 854.012868] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.012868] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.012868] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.013154] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.013259] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.035535] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d in Status: IN_PROGRESS for 2s [ 854.469475] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: SUCCESS [ 854.469893] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.469893] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.470269] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.470355] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.470533] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.470592] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.474026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.474026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.474026] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.973230] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.476263] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.853205] env[66502]: INFO networking_nsxv3.common.synchronization [req-bb316c4b-0b17-44d3-beec-ccdf38a62678 req-ad1d60ec-e54b-465c-878b-cc569d57ef64 tempest-ServersTestFqdnHostnames-1527225676 tempest-ServersTestFqdnHostnames-1527225676-project-member] Enqueued Resource ID: 6a050294-bf61-423f-b50c-cccbf8fa309f with Priority: HIGHEST for action security_group_members [ 855.853925] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a050294-bf61-423f-b50c-cccbf8fa309f with Priority: HIGHEST for action security_group_members [ 855.854737] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a050294-bf61-423f-b50c-cccbf8fa309f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.855171] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a050294-bf61-423f-b50c-cccbf8fa309f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.855171] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a050294-bf61-423f-b50c-cccbf8fa309f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.855948] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a050294-bf61-423f-b50c-cccbf8fa309f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.856157] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.856327] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.856374] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.856889] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.856889] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.857043] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a050294-bf61-423f-b50c-cccbf8fa309f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.984232] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.984232] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.984232] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.984232] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.984232] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.984232] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d226a97-2d69-4706-b98b-565700008c6f is going to be updated. [ 856.016570] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.020182] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.020182] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.020182] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.020182] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.028994] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: IN_PROGRESS for 2s [ 856.050476] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d in Status: SUCCESS [ 856.050676] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.346595] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-678 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.346829] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-678" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.346983] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-678" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.347690] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-678" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.347753] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.347896] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.348056] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.348385] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.348608] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.348836] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 856.348974] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 856.349127] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 856.349269] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 856.349422] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 856.349553] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 856.349719] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 856.360866] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.361195] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.361301] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.361661] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.361702] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.362395] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.362395] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.362395] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.362395] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.362730] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.362730] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a050294-bf61-423f-b50c-cccbf8fa309f already deleted. [ 856.362730] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a050294-bf61-423f-b50c-cccbf8fa309f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.372311] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 856.372521] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 856.372671] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 856.373412] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-678" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.373412] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-d9e127be-32b8-4212-89b0-ad731464ddc4 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.373412] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-d9e127be-32b8-4212-89b0-ad731464ddc4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.373596] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-d9e127be-32b8-4212-89b0-ad731464ddc4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.373882] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-d9e127be-32b8-4212-89b0-ad731464ddc4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.374037] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9e127be-32b8-4212-89b0-ad731464ddc4',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.876605] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.876943] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.876943] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.877138] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.877313] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.877448] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port d9e127be-32b8-4212-89b0-ad731464ddc4 not found, creating... [ 856.877734] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.877884] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.878011] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.878247] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.878375] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.878663] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.878820] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.878934] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.879169] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.879293] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.879429] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: d9e127be-32b8-4212-89b0-ad731464ddc4 is going to be created. [ 856.906366] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.906749] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.906749] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.907076] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.907283] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.907551] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-d9e127be-32b8-4212-89b0-ad731464ddc4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.593285] env[66502]: INFO networking_nsxv3.common.synchronization [req-bb316c4b-0b17-44d3-beec-ccdf38a62678 req-09599e74-1e5f-48f2-8bd5-dc09c80453f3 service nova] Enqueued Resource ID: 6a050294-bf61-423f-b50c-cccbf8fa309f with Priority: HIGHEST for action security_group_rules [ 857.593457] env[66502]: INFO networking_nsxv3.common.synchronization [req-bb316c4b-0b17-44d3-beec-ccdf38a62678 req-09599e74-1e5f-48f2-8bd5-dc09c80453f3 service nova] Enqueued Resource ID: 6a050294-bf61-423f-b50c-cccbf8fa309f with Priority: HIGHEST for action security_group_members [ 857.593841] env[66502]: INFO networking_nsxv3.common.synchronization [req-bb316c4b-0b17-44d3-beec-ccdf38a62678 req-09599e74-1e5f-48f2-8bd5-dc09c80453f3 service nova] Enqueued Resource ID: d9e127be-32b8-4212-89b0-ad731464ddc4 with Priority: HIGHEST for action port [ 857.594118] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a050294-bf61-423f-b50c-cccbf8fa309f with Priority: HIGHEST for action security_group_rules [ 857.594243] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a050294-bf61-423f-b50c-cccbf8fa309f with Priority: HIGHEST for action security_group_members [ 857.594337] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9e127be-32b8-4212-89b0-ad731464ddc4 with Priority: HIGHEST for action port [ 857.594598] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a050294-bf61-423f-b50c-cccbf8fa309f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.594748] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a050294-bf61-423f-b50c-cccbf8fa309f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.594818] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a050294-bf61-423f-b50c-cccbf8fa309f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.595026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a050294-bf61-423f-b50c-cccbf8fa309f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.595132] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a050294-bf61-423f-b50c-cccbf8fa309f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.596571] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a050294-bf61-423f-b50c-cccbf8fa309f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.596571] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a050294-bf61-423f-b50c-cccbf8fa309f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.596571] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a050294-bf61-423f-b50c-cccbf8fa309f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.596571] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a050294-bf61-423f-b50c-cccbf8fa309f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.596571] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.596571] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.596787] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.596787] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.596839] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.597503] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a050294-bf61-423f-b50c-cccbf8fa309f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.597704] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-d9e127be-32b8-4212-89b0-ad731464ddc4 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.598854] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d9e127be-32b8-4212-89b0-ad731464ddc4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.598854] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d9e127be-32b8-4212-89b0-ad731464ddc4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.598854] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d9e127be-32b8-4212-89b0-ad731464ddc4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.598854] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d9e127be-32b8-4212-89b0-ad731464ddc4',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.041895] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: SUCCESS [ 858.042168] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.042301] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.042524] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.042718] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.042833] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.042897] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.043150] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.043150] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.043256] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.043298] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.100904] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a050294-bf61-423f-b50c-cccbf8fa309f taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.101086] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a050294-bf61-423f-b50c-cccbf8fa309f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.101224] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6a050294-bf61-423f-b50c-cccbf8fa309f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.102336] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d9e127be-32b8-4212-89b0-ad731464ddc4 with status ACTIVE [ 858.103379] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.103379] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.103379] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.103379] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.103379] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.103379] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.103379] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.103379] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.103703] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.103703] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.103703] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.103873] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.103905] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.104098] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.104144] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.104182] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d9e127be-32b8-4212-89b0-ad731464ddc4 is going to be updated. [ 858.127727] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.127727] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.127727] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.127727] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.127727] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.127727] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d9e127be-32b8-4212-89b0-ad731464ddc4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.546256] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.546414] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.546536] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.546760] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.546961] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.547067] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.547139] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.549030] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.549030] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.549030] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.549030] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.549030] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.549030] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.549030] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.549030] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.549030] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.549030] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.549030] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.549030] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.549030] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.549030] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.607061] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6a050294-bf61-423f-b50c-cccbf8fa309f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.051910] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9d226a97-2d69-4706-b98b-565700008c6f: rpc.has_security_group_logging(os_id): False [ 859.072971] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.073207] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.073207] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.073305] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.073411] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.073574] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.073679] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.074668] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.074668] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.074668] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.074668] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.074668] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.074668] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.074668] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.074668] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.075094] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.075094] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.075094] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.075094] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.075094] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.075323] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d226a97-2d69-4706-b98b-565700008c6f is going to be updated. [ 859.111564] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.111768] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.111850] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.112087] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.112174] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.112516] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a050294-bf61-423f-b50c-cccbf8fa309f is going to be created. [ 859.142102] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.142350] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.142537] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.142806] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.143026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.157863] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.158051] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.158113] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.158320] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.158469] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.160097] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a050294-bf61-423f-b50c-cccbf8fa309f in Status: UNINITIALIZED for 2s [ 859.175551] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: IN_PROGRESS for 2s [ 860.318055] env[66502]: INFO networking_nsxv3.common.synchronization [req-afd2febc-e886-4479-aaf5-7c832ded54c0 req-a806455f-28a8-47ea-91d2-10b333fe191a tempest-ListServerFiltersTestJSON-1482878491 tempest-ListServerFiltersTestJSON-1482878491-project-member] Enqueued Resource ID: b96da033-21f1-44bb-a822-a4cb59139771 with Priority: HIGHEST for action security_group_members [ 860.318055] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b96da033-21f1-44bb-a822-a4cb59139771 with Priority: HIGHEST for action security_group_members [ 860.318055] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b96da033-21f1-44bb-a822-a4cb59139771 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.318730] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.318975] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.319340] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.320173] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.320173] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.320173] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.320173] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.320173] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.320173] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b96da033-21f1-44bb-a822-a4cb59139771',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.700167] env[66502]: INFO networking_nsxv3.common.synchronization [req-b55a89e7-a741-419a-a6dd-2303d6e14df6 req-c79af297-54ca-4cc9-beb0-4013783eac6b tempest-AttachInterfacesV270Test-1318192588 tempest-AttachInterfacesV270Test-1318192588-project-member] Enqueued Resource ID: 145e088c-6cef-4e3b-8451-5f708e7f0412 with Priority: HIGHEST for action security_group_members [ 860.700745] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 145e088c-6cef-4e3b-8451-5f708e7f0412 with Priority: HIGHEST for action security_group_members [ 860.701059] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-145e088c-6cef-4e3b-8451-5f708e7f0412 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.701550] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-145e088c-6cef-4e3b-8451-5f708e7f0412" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.701550] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-145e088c-6cef-4e3b-8451-5f708e7f0412" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.701714] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-145e088c-6cef-4e3b-8451-5f708e7f0412" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.702539] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.702719] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.702787] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.703024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.703153] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.703741] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('145e088c-6cef-4e3b-8451-5f708e7f0412',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.822518] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b96da033-21f1-44bb-a822-a4cb59139771',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.071650] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-189 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.071793] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-189" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.071793] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-189" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.072181] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-189" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.072554] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.072667] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.072806] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.073144] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.073821] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.073994] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 861.074125] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 861.074236] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 861.074347] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 861.074477] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 861.074598] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 861.074746] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 861.096698] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 861.096919] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 861.097091] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 861.097263] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-189" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.097884] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-a67f942f-bc4a-40b0-b5f4-4d5509657c09 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.097884] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-a67f942f-bc4a-40b0-b5f4-4d5509657c09" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.097884] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-a67f942f-bc4a-40b0-b5f4-4d5509657c09" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.098208] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-a67f942f-bc4a-40b0-b5f4-4d5509657c09" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.098350] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a67f942f-bc4a-40b0-b5f4-4d5509657c09',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.176197] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a050294-bf61-423f-b50c-cccbf8fa309f in Status: SUCCESS [ 861.176453] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a050294-bf61-423f-b50c-cccbf8fa309f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.177545] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a050294-bf61-423f-b50c-cccbf8fa309f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.177755] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a050294-bf61-423f-b50c-cccbf8fa309f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.177945] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.178074] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.178141] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.178323] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.178404] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.178489] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a050294-bf61-423f-b50c-cccbf8fa309f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.178578] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6a050294-bf61-423f-b50c-cccbf8fa309f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.194218] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: SUCCESS [ 861.194218] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.207378] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.207673] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.207912] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.208579] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.208579] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.208579] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.208737] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.208737] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.208822] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.208972] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.209082] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 145e088c-6cef-4e3b-8451-5f708e7f0412 already deleted. [ 861.209233] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-145e088c-6cef-4e3b-8451-5f708e7f0412" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.326617] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b96da033-21f1-44bb-a822-a4cb59139771',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.601151] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.601425] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.601541] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.601819] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.601989] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.602201] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port a67f942f-bc4a-40b0-b5f4-4d5509657c09 not found, creating... [ 861.602511] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.602634] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.602983] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.603196] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.603314] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.603749] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.603946] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.604482] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.604482] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.604755] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.604926] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: a67f942f-bc4a-40b0-b5f4-4d5509657c09 is going to be created. [ 861.631054] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.631054] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.631054] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.631420] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.631420] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.631577] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-a67f942f-bc4a-40b0-b5f4-4d5509657c09" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.680549] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6a050294-bf61-423f-b50c-cccbf8fa309f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.829401] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.829564] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.829721] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.829850] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.829941] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.830056] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b96da033-21f1-44bb-a822-a4cb59139771 is going to be updated. [ 861.870208] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.870530] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.870686] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.871128] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.871325] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.882060] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b96da033-21f1-44bb-a822-a4cb59139771 in Status: IN_PROGRESS for 2s [ 862.184274] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6a050294-bf61-423f-b50c-cccbf8fa309f: rpc.has_security_group_logging(os_id): False [ 862.204840] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.205009] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.205137] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.205386] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.205504] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.205870] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.206018] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.206196] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.206388] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.206480] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.206576] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a050294-bf61-423f-b50c-cccbf8fa309f is going to be created. [ 862.281157] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.281359] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.281429] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.281648] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.281829] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.310168] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a050294-bf61-423f-b50c-cccbf8fa309f in Status: IN_PROGRESS for 2s [ 862.382155] env[66502]: INFO networking_nsxv3.common.synchronization [req-b55a89e7-a741-419a-a6dd-2303d6e14df6 req-1dd453f5-ccd0-4ae1-8172-f3506ddabc6f service nova] Enqueued Resource ID: 145e088c-6cef-4e3b-8451-5f708e7f0412 with Priority: HIGHEST for action security_group_rules [ 862.382155] env[66502]: INFO networking_nsxv3.common.synchronization [req-b55a89e7-a741-419a-a6dd-2303d6e14df6 req-1dd453f5-ccd0-4ae1-8172-f3506ddabc6f service nova] Enqueued Resource ID: 145e088c-6cef-4e3b-8451-5f708e7f0412 with Priority: HIGHEST for action security_group_members [ 862.382155] env[66502]: INFO networking_nsxv3.common.synchronization [req-b55a89e7-a741-419a-a6dd-2303d6e14df6 req-1dd453f5-ccd0-4ae1-8172-f3506ddabc6f service nova] Enqueued Resource ID: a67f942f-bc4a-40b0-b5f4-4d5509657c09 with Priority: HIGHEST for action port [ 862.385273] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 145e088c-6cef-4e3b-8451-5f708e7f0412 with Priority: HIGHEST for action security_group_rules [ 862.386101] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 145e088c-6cef-4e3b-8451-5f708e7f0412 with Priority: HIGHEST for action security_group_members [ 862.386101] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a67f942f-bc4a-40b0-b5f4-4d5509657c09 with Priority: HIGHEST for action port [ 862.386101] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-145e088c-6cef-4e3b-8451-5f708e7f0412 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.386101] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-145e088c-6cef-4e3b-8451-5f708e7f0412" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.386101] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-145e088c-6cef-4e3b-8451-5f708e7f0412" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.386371] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-145e088c-6cef-4e3b-8451-5f708e7f0412" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.386457] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('145e088c-6cef-4e3b-8451-5f708e7f0412',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.391244] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-145e088c-6cef-4e3b-8451-5f708e7f0412 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.391244] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-145e088c-6cef-4e3b-8451-5f708e7f0412" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.391244] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-145e088c-6cef-4e3b-8451-5f708e7f0412" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.391244] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-145e088c-6cef-4e3b-8451-5f708e7f0412" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.391244] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.394725] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.394809] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.395025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.395122] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.395221] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('145e088c-6cef-4e3b-8451-5f708e7f0412',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.396313] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-a67f942f-bc4a-40b0-b5f4-4d5509657c09 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.396436] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a67f942f-bc4a-40b0-b5f4-4d5509657c09" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.396506] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a67f942f-bc4a-40b0-b5f4-4d5509657c09" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.396665] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a67f942f-bc4a-40b0-b5f4-4d5509657c09" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.396741] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a67f942f-bc4a-40b0-b5f4-4d5509657c09',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.902514] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-145e088c-6cef-4e3b-8451-5f708e7f0412 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.902514] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-145e088c-6cef-4e3b-8451-5f708e7f0412" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.902750] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('145e088c-6cef-4e3b-8451-5f708e7f0412',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.903719] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a67f942f-bc4a-40b0-b5f4-4d5509657c09 with status ACTIVE [ 862.903968] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.904121] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.904190] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.904450] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.904567] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.904744] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.904848] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.904913] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.905175] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.905288] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.905896] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.905896] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.905896] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.905896] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.906242] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.906242] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a67f942f-bc4a-40b0-b5f4-4d5509657c09 is going to be updated. [ 862.931374] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.931628] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.931700] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.931969] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.932207] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.932775] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a67f942f-bc4a-40b0-b5f4-4d5509657c09" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.410599] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('145e088c-6cef-4e3b-8451-5f708e7f0412',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.897200] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b96da033-21f1-44bb-a822-a4cb59139771 in Status: SUCCESS [ 863.897415] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.915170] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.915363] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.915404] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.915763] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.915827] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.916030] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 145e088c-6cef-4e3b-8451-5f708e7f0412 is going to be created. [ 863.947697] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.947943] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.948063] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.948526] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.948619] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.960957] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 145e088c-6cef-4e3b-8451-5f708e7f0412 in Status: UNINITIALIZED for 2s [ 864.325661] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6a050294-bf61-423f-b50c-cccbf8fa309f in Status: SUCCESS [ 864.325961] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a050294-bf61-423f-b50c-cccbf8fa309f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.700096] env[66502]: INFO networking_nsxv3.common.synchronization [req-f6353903-debb-4925-b488-9fc0591279c2 req-92e9cb69-7c35-4071-a3d8-49ab8d715cfc tempest-ServersTestJSON-1210226259 tempest-ServersTestJSON-1210226259-project-member] Enqueued Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_members [ 864.700783] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_members [ 864.700783] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.700783] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.700783] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.701510] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.701510] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.701746] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.701746] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.701823] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.701914] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.701972] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.204133] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.705953] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.974052] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 145e088c-6cef-4e3b-8451-5f708e7f0412 in Status: SUCCESS [ 865.974311] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-145e088c-6cef-4e3b-8451-5f708e7f0412" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.974486] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-145e088c-6cef-4e3b-8451-5f708e7f0412" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.974725] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-145e088c-6cef-4e3b-8451-5f708e7f0412" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.974924] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.975091] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.975185] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.975378] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.975470] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.975574] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-145e088c-6cef-4e3b-8451-5f708e7f0412" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.975721] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('145e088c-6cef-4e3b-8451-5f708e7f0412',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.209045] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.209045] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.209045] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.209215] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.209265] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.209405] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d226a97-2d69-4706-b98b-565700008c6f is going to be updated. [ 866.245791] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.245791] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.245791] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.246054] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.246212] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.259559] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: IN_PROGRESS for 2s [ 866.478802] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-145e088c-6cef-4e3b-8451-5f708e7f0412 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.478944] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-145e088c-6cef-4e3b-8451-5f708e7f0412" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.479030] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-145e088c-6cef-4e3b-8451-5f708e7f0412" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.479262] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-145e088c-6cef-4e3b-8451-5f708e7f0412" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.479482] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.479534] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.479607] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.479754] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.479840] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.479928] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-145e088c-6cef-4e3b-8451-5f708e7f0412" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.480090] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-145e088c-6cef-4e3b-8451-5f708e7f0412 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.480183] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-145e088c-6cef-4e3b-8451-5f708e7f0412" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.480243] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-145e088c-6cef-4e3b-8451-5f708e7f0412" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.480385] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-145e088c-6cef-4e3b-8451-5f708e7f0412" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.480519] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.480608] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.480667] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.480801] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.480871] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.480998] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-145e088c-6cef-4e3b-8451-5f708e7f0412" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.481083] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('145e088c-6cef-4e3b-8451-5f708e7f0412',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.983819] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 145e088c-6cef-4e3b-8451-5f708e7f0412: rpc.has_security_group_logging(os_id): False [ 867.005756] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.005942] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.005990] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.006335] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.006465] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.006680] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.006781] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.006843] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.007069] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.007140] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.007352] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.007467] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.007561] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.007729] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.007828] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.008193] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.008421] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.008421] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.008580] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.008676] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.008783] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 145e088c-6cef-4e3b-8451-5f708e7f0412 is going to be created. [ 867.079575] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.079800] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.079919] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.080305] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.080493] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.100947] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 145e088c-6cef-4e3b-8451-5f708e7f0412 in Status: IN_PROGRESS for 2s [ 867.501389] env[66502]: INFO networking_nsxv3.common.synchronization [None req-573d5226-4e21-4e1b-bb0d-2227b1444c74 None None] Enqueued Resource ID: 2594740c-9212-446b-8fea-6431044a2de4 with Priority: HIGHEST for action port [ 867.501915] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2594740c-9212-446b-8fea-6431044a2de4 with Priority: HIGHEST for action port [ 867.502232] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-2594740c-9212-446b-8fea-6431044a2de4 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.502377] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2594740c-9212-446b-8fea-6431044a2de4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.502455] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2594740c-9212-446b-8fea-6431044a2de4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.502740] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2594740c-9212-446b-8fea-6431044a2de4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.502821] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2594740c-9212-446b-8fea-6431044a2de4',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.004930] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2594740c-9212-446b-8fea-6431044a2de4 [ 868.005192] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.005326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.005384] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.005600] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.005688] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.005791] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2594740c-9212-446b-8fea-6431044a2de4 already deleted. [ 868.006729] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2594740c-9212-446b-8fea-6431044a2de4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.275076] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: SUCCESS [ 868.275309] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.114967] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 145e088c-6cef-4e3b-8451-5f708e7f0412 in Status: SUCCESS [ 869.115328] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-145e088c-6cef-4e3b-8451-5f708e7f0412" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.681208] env[66502]: INFO networking_nsxv3.common.synchronization [None req-f6b1467f-885c-406a-b210-b48a65e520f8 None None] Enqueued Resource ID: 0bfc083f-a785-42b9-89f7-43cf416d0049 with Priority: HIGHEST for action port [ 869.681729] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bfc083f-a785-42b9-89f7-43cf416d0049 with Priority: HIGHEST for action port [ 869.682145] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-0bfc083f-a785-42b9-89f7-43cf416d0049 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.682339] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0bfc083f-a785-42b9-89f7-43cf416d0049" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.682429] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0bfc083f-a785-42b9-89f7-43cf416d0049" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.682852] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0bfc083f-a785-42b9-89f7-43cf416d0049" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.682852] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bfc083f-a785-42b9-89f7-43cf416d0049',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.184931] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0bfc083f-a785-42b9-89f7-43cf416d0049 [ 870.185337] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.185337] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.185474] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.185649] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.185741] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.185852] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0bfc083f-a785-42b9-89f7-43cf416d0049 already deleted. [ 870.185965] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0bfc083f-a785-42b9-89f7-43cf416d0049" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.059537] env[66502]: INFO networking_nsxv3.common.synchronization [req-c1549168-ef9e-4c90-af23-e2e0548fe9a0 req-ae267b25-7080-4003-958e-edfba15b5758 tempest-ServerActionsTestOtherB-501490242 tempest-ServerActionsTestOtherB-501490242-project-member] Enqueued Resource ID: 670eb61a-b688-45b2-9400-64232c7b8af0 with Priority: HIGHEST for action security_group_members [ 871.059537] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 670eb61a-b688-45b2-9400-64232c7b8af0 with Priority: HIGHEST for action security_group_members [ 871.059889] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-670eb61a-b688-45b2-9400-64232c7b8af0 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.059971] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.060038] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.060275] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.060461] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.060647] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.060698] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.060832] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.060917] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.061036] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('670eb61a-b688-45b2-9400-64232c7b8af0',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.463719] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-427 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.463719] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-427" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.463719] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-427" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.463719] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-427" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.464330] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.464403] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.464684] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.464892] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.465101] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.465343] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 871.465467] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 871.465879] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 871.465879] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 871.466046] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 871.466124] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 871.466311] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 871.490529] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 871.490529] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 871.490529] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 871.490529] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-427" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.490529] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-3bf42dd7-897e-4677-bf09-4e33727f9efb taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.490529] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-3bf42dd7-897e-4677-bf09-4e33727f9efb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.490529] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-3bf42dd7-897e-4677-bf09-4e33727f9efb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.490529] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-3bf42dd7-897e-4677-bf09-4e33727f9efb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.490529] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bf42dd7-897e-4677-bf09-4e33727f9efb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.563914] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.564104] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.564184] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.564556] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.564556] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.564677] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.565052] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.565052] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.565052] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.565052] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.565211] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 670eb61a-b688-45b2-9400-64232c7b8af0 already deleted. [ 871.565211] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.994195] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.994416] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.994551] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.994845] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.994990] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.995157] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port 3bf42dd7-897e-4677-bf09-4e33727f9efb not found, creating... [ 871.995499] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.995681] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.995681] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.995944] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.996243] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.996618] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.996834] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.996999] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.997278] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.997422] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.997566] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: 3bf42dd7-897e-4677-bf09-4e33727f9efb is going to be created. [ 872.020735] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.020985] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.021174] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.021630] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.021983] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.022249] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-3bf42dd7-897e-4677-bf09-4e33727f9efb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.786067] env[66502]: INFO networking_nsxv3.common.synchronization [req-c1549168-ef9e-4c90-af23-e2e0548fe9a0 req-a8a58273-558c-40f6-bcef-2dc66d141274 service nova] Enqueued Resource ID: 670eb61a-b688-45b2-9400-64232c7b8af0 with Priority: HIGHEST for action security_group_rules [ 872.786377] env[66502]: INFO networking_nsxv3.common.synchronization [req-c1549168-ef9e-4c90-af23-e2e0548fe9a0 req-a8a58273-558c-40f6-bcef-2dc66d141274 service nova] Enqueued Resource ID: 670eb61a-b688-45b2-9400-64232c7b8af0 with Priority: HIGHEST for action security_group_members [ 872.786600] env[66502]: INFO networking_nsxv3.common.synchronization [req-c1549168-ef9e-4c90-af23-e2e0548fe9a0 req-a8a58273-558c-40f6-bcef-2dc66d141274 service nova] Enqueued Resource ID: 3bf42dd7-897e-4677-bf09-4e33727f9efb with Priority: HIGHEST for action port [ 872.787379] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 670eb61a-b688-45b2-9400-64232c7b8af0 with Priority: HIGHEST for action security_group_rules [ 872.787578] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 670eb61a-b688-45b2-9400-64232c7b8af0 with Priority: HIGHEST for action security_group_members [ 872.787728] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3bf42dd7-897e-4677-bf09-4e33727f9efb with Priority: HIGHEST for action port [ 872.788309] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-670eb61a-b688-45b2-9400-64232c7b8af0 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.788402] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.788512] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.789907] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.789907] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('670eb61a-b688-45b2-9400-64232c7b8af0',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.792347] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-670eb61a-b688-45b2-9400-64232c7b8af0 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.792514] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.792614] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.792891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.793163] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.793163] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.793163] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.793163] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.793779] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 872.793897] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('670eb61a-b688-45b2-9400-64232c7b8af0',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 872.796490] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-3bf42dd7-897e-4677-bf09-4e33727f9efb taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 872.796562] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3bf42dd7-897e-4677-bf09-4e33727f9efb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 872.796673] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3bf42dd7-897e-4677-bf09-4e33727f9efb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 872.796937] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3bf42dd7-897e-4677-bf09-4e33727f9efb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 872.797103] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3bf42dd7-897e-4677-bf09-4e33727f9efb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.299204] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('670eb61a-b688-45b2-9400-64232c7b8af0',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.300856] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-670eb61a-b688-45b2-9400-64232c7b8af0 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.301026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.301677] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3bf42dd7-897e-4677-bf09-4e33727f9efb with status ACTIVE [ 873.301865] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.302528] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.302528] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.302639] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.302782] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.303108] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.303311] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.303467] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.303767] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.304000] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.304285] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.305233] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.305233] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.305233] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.305233] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.305233] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3bf42dd7-897e-4677-bf09-4e33727f9efb is going to be updated. [ 873.329173] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.329173] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.329468] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.330163] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.330163] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.330163] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3bf42dd7-897e-4677-bf09-4e33727f9efb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.807598] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('670eb61a-b688-45b2-9400-64232c7b8af0',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.309720] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.309924] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.310048] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.310181] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.310272] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.310369] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 670eb61a-b688-45b2-9400-64232c7b8af0 is going to be created. [ 874.337951] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 874.338265] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.338265] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 874.338479] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 874.338636] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 874.350087] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 670eb61a-b688-45b2-9400-64232c7b8af0 in Status: UNINITIALIZED for 2s [ 876.019576] env[66502]: INFO networking_nsxv3.common.synchronization [req-1ee64808-128e-481d-be52-7262498d03ce req-aff7c44f-c77d-43b0-8867-7bbdb9971c3e tempest-ServerActionsTestJSON-2133613622 tempest-ServerActionsTestJSON-2133613622-project-member] Enqueued Resource ID: b10a43dc-2d28-4687-a424-05a1ebdfa3c3 with Priority: HIGHEST for action security_group_members [ 876.020283] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b10a43dc-2d28-4687-a424-05a1ebdfa3c3 with Priority: HIGHEST for action security_group_members [ 876.020769] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b10a43dc-2d28-4687-a424-05a1ebdfa3c3 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.020769] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b10a43dc-2d28-4687-a424-05a1ebdfa3c3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.020769] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b10a43dc-2d28-4687-a424-05a1ebdfa3c3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.021226] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b10a43dc-2d28-4687-a424-05a1ebdfa3c3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.021336] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.021483] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.021581] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.021865] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.021929] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.022080] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b10a43dc-2d28-4687-a424-05a1ebdfa3c3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.367063] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 670eb61a-b688-45b2-9400-64232c7b8af0 in Status: SUCCESS [ 876.367063] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.367714] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.367949] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.368405] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.368584] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.368614] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.368791] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.368906] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.369014] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.369117] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('670eb61a-b688-45b2-9400-64232c7b8af0',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.371747] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-834 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.371929] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-834" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.372046] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-834" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.372592] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-834" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.372592] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.372949] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.372949] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.373165] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.373287] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.373491] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 876.373599] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 876.373701] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 876.373802] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 876.373971] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 876.374082] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 876.374207] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 876.399061] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 876.399340] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 876.399495] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 876.399773] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-834" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.400211] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-96968ed2-524a-4501-a7d1-7490fddfa884 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.401258] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-96968ed2-524a-4501-a7d1-7490fddfa884" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.401258] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-96968ed2-524a-4501-a7d1-7490fddfa884" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.401258] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-96968ed2-524a-4501-a7d1-7490fddfa884" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.401258] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96968ed2-524a-4501-a7d1-7490fddfa884',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.525078] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.525295] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.525375] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.525586] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.525675] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.525875] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.526032] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.526121] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.526261] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.526345] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.526430] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b10a43dc-2d28-4687-a424-05a1ebdfa3c3 already deleted. [ 876.526508] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b10a43dc-2d28-4687-a424-05a1ebdfa3c3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.871097] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('670eb61a-b688-45b2-9400-64232c7b8af0',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.903515] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.903785] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.904078] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.904467] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.904672] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.904859] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port 96968ed2-524a-4501-a7d1-7490fddfa884 not found, creating... [ 876.905260] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.905435] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.905569] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.905854] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.906684] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.907664] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.907985] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.908194] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.908468] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.908640] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.908840] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: 96968ed2-524a-4501-a7d1-7490fddfa884 is going to be created. [ 876.935208] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.935443] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.935566] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.935855] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.936212] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.936479] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-96968ed2-524a-4501-a7d1-7490fddfa884" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.373885] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 670eb61a-b688-45b2-9400-64232c7b8af0: rpc.has_security_group_logging(os_id): False [ 877.394839] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.395025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.395025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.397757] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.397757] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.397757] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.397757] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.397757] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.397757] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.397757] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.397985] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 670eb61a-b688-45b2-9400-64232c7b8af0 is going to be created. [ 877.462920] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.463088] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.463158] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.463373] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.463551] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.474850] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 670eb61a-b688-45b2-9400-64232c7b8af0 in Status: IN_PROGRESS for 2s [ 877.665471] env[66502]: INFO networking_nsxv3.common.synchronization [req-1ee64808-128e-481d-be52-7262498d03ce req-92dac368-6d40-47f8-8dd6-5453f7de67a8 service nova] Enqueued Resource ID: b10a43dc-2d28-4687-a424-05a1ebdfa3c3 with Priority: HIGHEST for action security_group_rules [ 877.665643] env[66502]: INFO networking_nsxv3.common.synchronization [req-1ee64808-128e-481d-be52-7262498d03ce req-92dac368-6d40-47f8-8dd6-5453f7de67a8 service nova] Enqueued Resource ID: b10a43dc-2d28-4687-a424-05a1ebdfa3c3 with Priority: HIGHEST for action security_group_members [ 877.665816] env[66502]: INFO networking_nsxv3.common.synchronization [req-1ee64808-128e-481d-be52-7262498d03ce req-92dac368-6d40-47f8-8dd6-5453f7de67a8 service nova] Enqueued Resource ID: 96968ed2-524a-4501-a7d1-7490fddfa884 with Priority: HIGHEST for action port [ 877.666361] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b10a43dc-2d28-4687-a424-05a1ebdfa3c3 with Priority: HIGHEST for action security_group_rules [ 877.666490] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b10a43dc-2d28-4687-a424-05a1ebdfa3c3 with Priority: HIGHEST for action security_group_members [ 877.666586] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 96968ed2-524a-4501-a7d1-7490fddfa884 with Priority: HIGHEST for action port [ 877.666858] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b10a43dc-2d28-4687-a424-05a1ebdfa3c3 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.666979] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b10a43dc-2d28-4687-a424-05a1ebdfa3c3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.667059] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b10a43dc-2d28-4687-a424-05a1ebdfa3c3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.667290] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b10a43dc-2d28-4687-a424-05a1ebdfa3c3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.667374] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b10a43dc-2d28-4687-a424-05a1ebdfa3c3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.668292] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b10a43dc-2d28-4687-a424-05a1ebdfa3c3 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.668406] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b10a43dc-2d28-4687-a424-05a1ebdfa3c3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.668486] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b10a43dc-2d28-4687-a424-05a1ebdfa3c3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.668724] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b10a43dc-2d28-4687-a424-05a1ebdfa3c3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.668896] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.668996] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.669073] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.669219] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.670306] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.670306] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b10a43dc-2d28-4687-a424-05a1ebdfa3c3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.670306] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-96968ed2-524a-4501-a7d1-7490fddfa884 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.670306] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-96968ed2-524a-4501-a7d1-7490fddfa884" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.670306] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-96968ed2-524a-4501-a7d1-7490fddfa884" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.670782] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-96968ed2-524a-4501-a7d1-7490fddfa884" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.670782] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('96968ed2-524a-4501-a7d1-7490fddfa884',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.807783] env[66502]: INFO networking_nsxv3.common.synchronization [req-cda6f4ba-1471-4085-86e7-e976b9b95743 req-8cec364d-b184-4727-a8aa-3dd5db07f1ae tempest-AttachInterfacesV270Test-1318192588 tempest-AttachInterfacesV270Test-1318192588-project-member] Enqueued Resource ID: 145e088c-6cef-4e3b-8451-5f708e7f0412 with Priority: HIGHEST for action security_group_members [ 877.809583] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 145e088c-6cef-4e3b-8451-5f708e7f0412 with Priority: HIGHEST for action security_group_members [ 877.809876] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-145e088c-6cef-4e3b-8451-5f708e7f0412 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.810070] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-145e088c-6cef-4e3b-8451-5f708e7f0412" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.810173] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-145e088c-6cef-4e3b-8451-5f708e7f0412" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.810535] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-145e088c-6cef-4e3b-8451-5f708e7f0412" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.811112] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.811332] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.811435] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.812168] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.812168] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.812168] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('145e088c-6cef-4e3b-8451-5f708e7f0412',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.171867] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b10a43dc-2d28-4687-a424-05a1ebdfa3c3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.173319] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b10a43dc-2d28-4687-a424-05a1ebdfa3c3 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.173477] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b10a43dc-2d28-4687-a424-05a1ebdfa3c3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.174079] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 96968ed2-524a-4501-a7d1-7490fddfa884 with status ACTIVE [ 878.174330] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.174466] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.174574] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.174814] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.174959] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.175167] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.175288] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.175367] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.175575] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.175660] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.175933] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.176130] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.176171] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.176336] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.176417] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.176505] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 96968ed2-524a-4501-a7d1-7490fddfa884 is going to be updated. [ 878.200587] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.200735] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.200805] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.201034] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.201278] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.201380] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-96968ed2-524a-4501-a7d1-7490fddfa884" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.315616] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.315616] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.315616] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.315894] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.315894] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.316065] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.316264] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.316264] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.316396] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.316520] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.316667] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 145e088c-6cef-4e3b-8451-5f708e7f0412 is going to be updated. [ 878.366096] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.366322] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.366391] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.366583] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.366844] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.377182] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 145e088c-6cef-4e3b-8451-5f708e7f0412 in Status: IN_PROGRESS for 2s [ 878.675148] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b10a43dc-2d28-4687-a424-05a1ebdfa3c3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.179582] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.179759] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.179844] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.180104] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.180213] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.180318] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b10a43dc-2d28-4687-a424-05a1ebdfa3c3 is going to be created. [ 879.208994] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.209244] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.209244] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.209586] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.209833] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.221373] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b10a43dc-2d28-4687-a424-05a1ebdfa3c3 in Status: UNINITIALIZED for 2s [ 879.490258] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 670eb61a-b688-45b2-9400-64232c7b8af0 in Status: SUCCESS [ 879.490643] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.394326] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 145e088c-6cef-4e3b-8451-5f708e7f0412 in Status: SUCCESS [ 880.394498] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 145e088c-6cef-4e3b-8451-5f708e7f0412 deletion is rescheduled due to dependency. [ 880.394612] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-145e088c-6cef-4e3b-8451-5f708e7f0412" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.239427] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b10a43dc-2d28-4687-a424-05a1ebdfa3c3 in Status: SUCCESS [ 881.239869] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b10a43dc-2d28-4687-a424-05a1ebdfa3c3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.239869] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b10a43dc-2d28-4687-a424-05a1ebdfa3c3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.240079] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b10a43dc-2d28-4687-a424-05a1ebdfa3c3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.240283] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.240408] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.240477] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.240692] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.240779] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.240873] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b10a43dc-2d28-4687-a424-05a1ebdfa3c3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.240970] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b10a43dc-2d28-4687-a424-05a1ebdfa3c3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.743792] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b10a43dc-2d28-4687-a424-05a1ebdfa3c3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.246208] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b10a43dc-2d28-4687-a424-05a1ebdfa3c3: rpc.has_security_group_logging(os_id): False [ 882.266570] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.266737] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.266805] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.267022] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.267115] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.267364] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.267466] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.267520] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.267672] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.267747] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.267853] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b10a43dc-2d28-4687-a424-05a1ebdfa3c3 is going to be created. [ 882.324798] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.324973] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.325024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.325225] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.325396] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.335805] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b10a43dc-2d28-4687-a424-05a1ebdfa3c3 in Status: IN_PROGRESS for 2s [ 882.810719] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 882.810817] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 884.349583] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b10a43dc-2d28-4687-a424-05a1ebdfa3c3 in Status: SUCCESS [ 884.349876] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b10a43dc-2d28-4687-a424-05a1ebdfa3c3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.405495] env[66502]: INFO networking_nsxv3.common.synchronization [req-3f3444e7-681d-4512-b3f3-80ec184934d7 req-a0e34dc7-0cf7-4a06-95c7-5ac70a518a8c tempest-ServersWithSpecificFlavorTestJSON-713469048 tempest-ServersWithSpecificFlavorTestJSON-713469048-project-member] Enqueued Resource ID: 7421254e-fac2-4232-97e1-1f7373688543 with Priority: HIGHEST for action security_group_members [ 884.406754] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7421254e-fac2-4232-97e1-1f7373688543 with Priority: HIGHEST for action security_group_members [ 884.406754] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-7421254e-fac2-4232-97e1-1f7373688543 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.407547] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.407547] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.407547] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.407547] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.407547] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.407547] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.407764] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.407764] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.407847] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7421254e-fac2-4232-97e1-1f7373688543',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.911130] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.911130] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.911313] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.911435] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.938422] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.938614] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.938828] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.939013] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.939265] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.939367] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.939487] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7421254e-fac2-4232-97e1-1f7373688543 is going to be updated. [ 884.973263] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.973453] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.973539] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.973789] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.973954] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.984156] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7421254e-fac2-4232-97e1-1f7373688543 in Status: IN_PROGRESS for 2s [ 886.996083] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7421254e-fac2-4232-97e1-1f7373688543 in Status: SUCCESS [ 886.996437] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7421254e-fac2-4232-97e1-1f7373688543 deletion is rescheduled due to dependency. [ 886.996437] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7421254e-fac2-4232-97e1-1f7373688543" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.406872] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 889.407185] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 890.264747] env[66502]: INFO networking_nsxv3.common.synchronization [req-1f539518-4425-433d-9df2-741f097cb28e req-79057777-7f09-4927-9e4d-6b200e81065d tempest-AttachInterfacesUnderV243Test-1353172127 tempest-AttachInterfacesUnderV243Test-1353172127-project-member] Enqueued Resource ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 with Priority: HIGHEST for action security_group_members [ 890.265404] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 with Priority: HIGHEST for action security_group_members [ 890.265692] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-2728c2e7-59ab-4cf2-bc7c-4c079064da76 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.265776] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.265841] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.266156] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.266331] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.266433] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.266493] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.266652] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.266739] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.266832] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2728c2e7-59ab-4cf2-bc7c-4c079064da76',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.607411] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-524 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.607713] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-524" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.607713] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-524" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.608040] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-524" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.608944] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.608944] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.608944] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.608944] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.612135] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.612135] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 890.612135] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 890.612135] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 890.612135] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 890.612135] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 890.612338] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 890.612338] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 890.636085] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 890.636085] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 890.636085] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 890.636085] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-524" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.636085] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-70e83de1-5321-4460-b0c4-606c6cf63b1c taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.636085] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-70e83de1-5321-4460-b0c4-606c6cf63b1c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.636085] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-70e83de1-5321-4460-b0c4-606c6cf63b1c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.636085] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-70e83de1-5321-4460-b0c4-606c6cf63b1c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.636085] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70e83de1-5321-4460-b0c4-606c6cf63b1c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.768965] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.769214] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.769284] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.769632] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.769767] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.770187] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.770326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.770410] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.770629] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.770719] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.770827] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 already deleted. [ 890.770932] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.139138] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.139382] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.139506] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.139788] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.139933] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.140098] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 70e83de1-5321-4460-b0c4-606c6cf63b1c not found, creating... [ 891.140354] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.140503] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.140756] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.140822] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.140945] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.141237] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.141392] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.141500] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.141700] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.141827] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.141959] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 70e83de1-5321-4460-b0c4-606c6cf63b1c is going to be created. [ 891.172689] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.172944] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.173279] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.173449] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.173693] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.173944] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-70e83de1-5321-4460-b0c4-606c6cf63b1c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.872041] env[66502]: INFO networking_nsxv3.common.synchronization [req-1f539518-4425-433d-9df2-741f097cb28e req-1565af92-3e15-463d-8eff-5fc2d6eea117 service nova] Enqueued Resource ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 with Priority: HIGHEST for action security_group_rules [ 891.872280] env[66502]: INFO networking_nsxv3.common.synchronization [req-1f539518-4425-433d-9df2-741f097cb28e req-1565af92-3e15-463d-8eff-5fc2d6eea117 service nova] Enqueued Resource ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 with Priority: HIGHEST for action security_group_members [ 891.872374] env[66502]: INFO networking_nsxv3.common.synchronization [req-1f539518-4425-433d-9df2-741f097cb28e req-1565af92-3e15-463d-8eff-5fc2d6eea117 service nova] Enqueued Resource ID: 70e83de1-5321-4460-b0c4-606c6cf63b1c with Priority: HIGHEST for action port [ 891.873035] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 with Priority: HIGHEST for action security_group_rules [ 891.873270] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 with Priority: HIGHEST for action security_group_members [ 891.873270] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70e83de1-5321-4460-b0c4-606c6cf63b1c with Priority: HIGHEST for action port [ 891.873513] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2728c2e7-59ab-4cf2-bc7c-4c079064da76 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.873572] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.873601] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.873794] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.873880] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2728c2e7-59ab-4cf2-bc7c-4c079064da76',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.875057] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-2728c2e7-59ab-4cf2-bc7c-4c079064da76 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.878033] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.878033] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.878033] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.878033] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.878033] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.878033] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.878033] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.878033] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.878033] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2728c2e7-59ab-4cf2-bc7c-4c079064da76',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.878033] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-70e83de1-5321-4460-b0c4-606c6cf63b1c taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.878033] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70e83de1-5321-4460-b0c4-606c6cf63b1c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.878033] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70e83de1-5321-4460-b0c4-606c6cf63b1c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.878033] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70e83de1-5321-4460-b0c4-606c6cf63b1c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.878033] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70e83de1-5321-4460-b0c4-606c6cf63b1c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.259802] env[66502]: INFO networking_nsxv3.common.synchronization [req-e78ba535-2b01-481d-973c-74d98074d5be req-e215b52a-4a75-42bb-9c69-4733d98745f9 tempest-ServerActionsV293TestJSON-1501321181 tempest-ServerActionsV293TestJSON-1501321181-project-member] Enqueued Resource ID: 05164d98-30c1-459b-9f4c-ac294382c57e with Priority: HIGHEST for action security_group_members [ 892.260442] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05164d98-30c1-459b-9f4c-ac294382c57e with Priority: HIGHEST for action security_group_members [ 892.260755] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-05164d98-30c1-459b-9f4c-ac294382c57e taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.260878] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-05164d98-30c1-459b-9f4c-ac294382c57e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.260950] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-05164d98-30c1-459b-9f4c-ac294382c57e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.261184] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-05164d98-30c1-459b-9f4c-ac294382c57e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.261348] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.261461] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.261530] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.261686] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.261779] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.261894] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('05164d98-30c1-459b-9f4c-ac294382c57e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.382024] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-2728c2e7-59ab-4cf2-bc7c-4c079064da76 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.382024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.382024] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2728c2e7-59ab-4cf2-bc7c-4c079064da76',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.382024] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 70e83de1-5321-4460-b0c4-606c6cf63b1c with status ACTIVE [ 892.382024] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.382024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.382024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.382024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.382024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.382024] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.382024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.382024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.382024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.382024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.383574] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.383574] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.383574] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.384236] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.384236] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.384382] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 70e83de1-5321-4460-b0c4-606c6cf63b1c is going to be updated. [ 892.406540] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.406973] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.406973] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.406973] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.407107] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.407262] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70e83de1-5321-4460-b0c4-606c6cf63b1c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.764611] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.764787] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.764839] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.765048] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.788996] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.789268] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.789456] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.789456] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.789648] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.789758] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.789809] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05164d98-30c1-459b-9f4c-ac294382c57e is going to be updated. [ 892.817983] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.818147] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.818246] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.818417] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.818555] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.827827] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05164d98-30c1-459b-9f4c-ac294382c57e in Status: IN_PROGRESS for 2s [ 892.877538] env[66502]: INFO networking_nsxv3.common.synchronization [req-8b9dde16-f7f7-480d-ad6e-f412a402b239 req-0b1390f9-3d98-46dc-8826-81780ddbd27b tempest-ServersTestMultiNic-1258705533 tempest-ServersTestMultiNic-1258705533-project-member] Enqueued Resource ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 with Priority: HIGHEST for action security_group_members [ 892.881894] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 with Priority: HIGHEST for action security_group_members [ 892.884266] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.884491] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.884572] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.884820] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.884998] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.885122] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.885253] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.885371] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.885482] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.885588] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.886846] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2728c2e7-59ab-4cf2-bc7c-4c079064da76',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.286575] env[66502]: INFO networking_nsxv3.common.synchronization [req-8b9dde16-f7f7-480d-ad6e-f412a402b239 req-8a80ebc9-96cf-4b95-b116-4e4da60aa4f9 tempest-ServersTestMultiNic-1258705533 tempest-ServersTestMultiNic-1258705533-project-member] Enqueued Resource ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 with Priority: HIGHEST for action security_group_members [ 893.287416] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 with Priority: HIGHEST for action security_group_members [ 893.287462] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.287569] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.389294] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.389294] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.389294] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.389510] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.389722] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.390074] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.390791] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.390791] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.390791] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.390791] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.390791] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 is going to be updated. [ 893.396162] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.396162] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.396162] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.396162] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.396162] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.396162] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 is going to be created. [ 893.422938] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.423095] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.423172] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.423426] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.423589] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.426117] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.426550] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.426636] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.426836] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.426963] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.438782] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 in Status: IN_PROGRESS for 2s [ 893.439463] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 in Status: UNINITIALIZED for 2s [ 893.644093] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-634 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.644306] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-634" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.644850] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-634" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.645201] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-634" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.645471] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.645627] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.645741] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.645951] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.646113] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.646311] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 893.646421] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 893.646526] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 893.646627] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 893.646731] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 893.646832] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 893.647077] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 893.666968] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 893.667239] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 893.667492] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 893.667688] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-634" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.668015] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-3e20b641-4278-4066-8dfa-c8e0a8b399df taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.668236] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-3e20b641-4278-4066-8dfa-c8e0a8b399df" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.668425] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-3e20b641-4278-4066-8dfa-c8e0a8b399df" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.668839] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-3e20b641-4278-4066-8dfa-c8e0a8b399df" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.668989] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e20b641-4278-4066-8dfa-c8e0a8b399df',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.171320] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.171855] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.171855] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.172294] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.172509] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.172679] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 3e20b641-4278-4066-8dfa-c8e0a8b399df not found, creating... [ 894.172959] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.173163] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.173258] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.173494] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.173621] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.173909] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.174135] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.174245] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.174432] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.174610] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.174793] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 3e20b641-4278-4066-8dfa-c8e0a8b399df is going to be created. [ 894.199945] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.200188] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.200403] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.200622] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.200857] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.201179] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-3e20b641-4278-4066-8dfa-c8e0a8b399df" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.839716] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 05164d98-30c1-459b-9f4c-ac294382c57e in Status: SUCCESS [ 894.839962] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 05164d98-30c1-459b-9f4c-ac294382c57e deletion is rescheduled due to dependency. [ 894.840114] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-05164d98-30c1-459b-9f4c-ac294382c57e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.059463] env[66502]: INFO networking_nsxv3.common.synchronization [req-8b9dde16-f7f7-480d-ad6e-f412a402b239 req-ecdc92b9-4847-4992-b015-9927b05ea145 service nova] Enqueued Resource ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 with Priority: HIGHEST for action security_group_rules [ 895.059463] env[66502]: INFO networking_nsxv3.common.synchronization [req-8b9dde16-f7f7-480d-ad6e-f412a402b239 req-ecdc92b9-4847-4992-b015-9927b05ea145 service nova] Enqueued Resource ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 with Priority: HIGHEST for action security_group_members [ 895.060165] env[66502]: INFO networking_nsxv3.common.synchronization [req-8b9dde16-f7f7-480d-ad6e-f412a402b239 req-ecdc92b9-4847-4992-b015-9927b05ea145 service nova] Enqueued Resource ID: 3e20b641-4278-4066-8dfa-c8e0a8b399df with Priority: HIGHEST for action port [ 895.060795] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 with Priority: HIGHEST for action security_group_rules [ 895.060977] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 with Priority: HIGHEST for action security_group_members [ 895.061149] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e20b641-4278-4066-8dfa-c8e0a8b399df with Priority: HIGHEST for action port [ 895.061521] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0bae9bdb-dcb4-4110-bcb0-1b0548a94738 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.063306] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.063306] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.063306] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.063306] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.067357] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.067357] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.067357] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e20b641-4278-4066-8dfa-c8e0a8b399df taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.067357] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e20b641-4278-4066-8dfa-c8e0a8b399df" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.067357] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e20b641-4278-4066-8dfa-c8e0a8b399df" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.067357] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e20b641-4278-4066-8dfa-c8e0a8b399df" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.067357] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e20b641-4278-4066-8dfa-c8e0a8b399df',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.431958] env[66502]: INFO networking_nsxv3.common.synchronization [req-0ec3bdff-8572-4df7-b55d-2cf3c8fda276 req-a4745851-fdd5-4c61-9284-5166e21c925d tempest-ServerDiskConfigTestJSON-940033598 tempest-ServerDiskConfigTestJSON-940033598-project-member] Enqueued Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGHEST for action security_group_members [ 895.432613] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGHEST for action security_group_members [ 895.433050] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-aba51398-48dc-4f5e-b3cf-1da4130d58fb taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.433745] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.433745] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.433942] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.434171] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.434283] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.434345] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.434870] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.434870] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.434870] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.451295] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 in Status: SUCCESS [ 895.451378] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 deletion is rescheduled due to dependency. [ 895.451452] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.452159] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 in Status: SUCCESS [ 895.452326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.452464] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.452698] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.452879] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.452989] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.453061] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.453215] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.453294] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.453389] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.454169] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.454323] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.454484] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.454586] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.454646] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.454786] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.454861] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.454942] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.455041] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2728c2e7-59ab-4cf2-bc7c-4c079064da76',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.567044] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.567209] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.567414] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3e20b641-4278-4066-8dfa-c8e0a8b399df with status ACTIVE [ 895.567601] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.567703] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.567772] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.567971] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.568065] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.568225] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.568344] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.570070] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.570070] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.570070] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.570070] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.570070] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.570070] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.570070] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.570070] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.570070] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3e20b641-4278-4066-8dfa-c8e0a8b399df is going to be updated. [ 895.595028] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.595028] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.595028] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.595028] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.595028] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.595028] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e20b641-4278-4066-8dfa-c8e0a8b399df" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.806779] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-509 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.806932] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-509" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.807371] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-509" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.807371] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-509" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.807613] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.807774] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.807888] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.808121] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.808574] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.808574] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 895.808673] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 895.808704] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 895.808806] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 895.808909] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 895.809020] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 895.809147] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 895.828742] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 895.829191] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 895.829191] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 895.829375] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-509" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.829559] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-83db9863-6931-46e1-acf7-4fa3aa3bef88 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.829712] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-83db9863-6931-46e1-acf7-4fa3aa3bef88" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.830099] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-83db9863-6931-46e1-acf7-4fa3aa3bef88" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.830195] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-83db9863-6931-46e1-acf7-4fa3aa3bef88" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.830351] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83db9863-6931-46e1-acf7-4fa3aa3bef88',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.877933] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-135 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.878133] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-135" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.878260] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-135" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.878649] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-135" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.878912] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.879225] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.879382] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.879704] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.879854] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.880074] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 895.880179] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 895.880287] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 895.880392] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 895.880837] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 895.880980] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 895.881145] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 895.903943] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 895.904179] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 895.904348] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 895.904756] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-135" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.904885] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-e5d90b2d-3f1f-430c-9459-a9a36aefacfa taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.905101] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-e5d90b2d-3f1f-430c-9459-a9a36aefacfa" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.905237] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-e5d90b2d-3f1f-430c-9459-a9a36aefacfa" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.906705] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-e5d90b2d-3f1f-430c-9459-a9a36aefacfa" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.906985] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5d90b2d-3f1f-430c-9459-a9a36aefacfa',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.937035] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.937251] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.937297] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.937500] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.937595] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.937796] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.937892] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.937955] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.938162] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.938294] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.938445] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb is going to be updated. [ 895.956339] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.958846] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2728c2e7-59ab-4cf2-bc7c-4c079064da76',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.964945] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.965091] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.965137] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.965337] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.965495] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.975603] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb in Status: IN_PROGRESS for 2s [ 896.333358] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.333667] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.333820] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.334259] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.334468] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.334676] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 83db9863-6931-46e1-acf7-4fa3aa3bef88 not found, creating... [ 896.335067] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.335208] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.335350] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.335632] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.335810] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.336228] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.336413] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.336571] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.336839] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.337015] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.337192] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 83db9863-6931-46e1-acf7-4fa3aa3bef88 is going to be created. [ 896.362053] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.362372] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.362527] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.362834] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.363329] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.363607] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-83db9863-6931-46e1-acf7-4fa3aa3bef88" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.410292] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.410510] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.410566] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.410863] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.411027] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.411227] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port e5d90b2d-3f1f-430c-9459-a9a36aefacfa not found, creating... [ 896.411535] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.411753] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.411845] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.412092] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.412255] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.412618] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.412789] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.412907] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.413130] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.413265] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.413412] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: e5d90b2d-3f1f-430c-9459-a9a36aefacfa is going to be created. [ 896.447448] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.447864] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.447864] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.448067] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.448303] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.448575] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-e5d90b2d-3f1f-430c-9459-a9a36aefacfa" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.458419] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.460050] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2728c2e7-59ab-4cf2-bc7c-4c079064da76: rpc.has_security_group_logging(os_id): False [ 896.479254] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.479487] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.479487] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.479665] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.479782] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.480057] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.480181] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.480236] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.480402] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.480481] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.480573] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 is going to be created. [ 896.571860] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.572188] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.572188] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.572359] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.572507] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.605888] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 in Status: IN_PROGRESS for 2s [ 896.960515] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.960689] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.960730] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.960965] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.961457] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.961457] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 is going to be updated. [ 896.990645] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.990852] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.990897] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.991120] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.991290] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.002153] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 in Status: IN_PROGRESS for 2s [ 897.095792] env[66502]: INFO networking_nsxv3.common.synchronization [req-0ec3bdff-8572-4df7-b55d-2cf3c8fda276 req-20860b45-b554-4bd9-887d-45358a2ccd19 service nova] Enqueued Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGHEST for action security_group_rules [ 897.095927] env[66502]: INFO networking_nsxv3.common.synchronization [req-0ec3bdff-8572-4df7-b55d-2cf3c8fda276 req-20860b45-b554-4bd9-887d-45358a2ccd19 service nova] Enqueued Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGHEST for action security_group_members [ 897.096191] env[66502]: INFO networking_nsxv3.common.synchronization [req-0ec3bdff-8572-4df7-b55d-2cf3c8fda276 req-20860b45-b554-4bd9-887d-45358a2ccd19 service nova] Enqueued Resource ID: 83db9863-6931-46e1-acf7-4fa3aa3bef88 with Priority: HIGHEST for action port [ 897.097359] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGHEST for action security_group_rules [ 897.097583] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGHEST for action security_group_members [ 897.097722] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 83db9863-6931-46e1-acf7-4fa3aa3bef88 with Priority: HIGHEST for action port [ 897.098058] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aba51398-48dc-4f5e-b3cf-1da4130d58fb taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.098483] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.098626] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.098857] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.098963] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.100809] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-aba51398-48dc-4f5e-b3cf-1da4130d58fb taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.100993] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.101248] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-83db9863-6931-46e1-acf7-4fa3aa3bef88 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.101388] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-83db9863-6931-46e1-acf7-4fa3aa3bef88" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.101569] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-83db9863-6931-46e1-acf7-4fa3aa3bef88" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.102011] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-83db9863-6931-46e1-acf7-4fa3aa3bef88" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.102011] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('83db9863-6931-46e1-acf7-4fa3aa3bef88',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.119216] env[66502]: INFO networking_nsxv3.common.synchronization [req-8b9dde16-f7f7-480d-ad6e-f412a402b239 req-9a281c6c-8b26-47cb-83b4-3a20fc5d906e service nova] Enqueued Resource ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 with Priority: HIGHEST for action security_group_rules [ 897.119324] env[66502]: INFO networking_nsxv3.common.synchronization [req-8b9dde16-f7f7-480d-ad6e-f412a402b239 req-9a281c6c-8b26-47cb-83b4-3a20fc5d906e service nova] Enqueued Resource ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 with Priority: HIGHEST for action security_group_members [ 897.119460] env[66502]: INFO networking_nsxv3.common.synchronization [req-8b9dde16-f7f7-480d-ad6e-f412a402b239 req-9a281c6c-8b26-47cb-83b4-3a20fc5d906e service nova] Enqueued Resource ID: e5d90b2d-3f1f-430c-9459-a9a36aefacfa with Priority: HIGHEST for action port [ 897.119913] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 with Priority: HIGHEST for action security_group_rules [ 897.120058] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 with Priority: HIGHEST for action security_group_members [ 897.120156] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5d90b2d-3f1f-430c-9459-a9a36aefacfa with Priority: HIGHEST for action port [ 897.120632] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0bae9bdb-dcb4-4110-bcb0-1b0548a94738 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.120796] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.120969] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.121526] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.121526] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5d90b2d-3f1f-430c-9459-a9a36aefacfa taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.121526] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5d90b2d-3f1f-430c-9459-a9a36aefacfa" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.121526] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5d90b2d-3f1f-430c-9459-a9a36aefacfa" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.122136] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5d90b2d-3f1f-430c-9459-a9a36aefacfa" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.122281] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5d90b2d-3f1f-430c-9459-a9a36aefacfa',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.604537] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-aba51398-48dc-4f5e-b3cf-1da4130d58fb taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.604803] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.604803] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 83db9863-6931-46e1-acf7-4fa3aa3bef88 with status ACTIVE [ 897.604927] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.605069] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.605143] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.605360] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.605450] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.605621] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.605722] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.605785] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.605936] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.606020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.606364] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.606485] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.606555] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.606715] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.606828] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.606879] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 83db9863-6931-46e1-acf7-4fa3aa3bef88 is going to be updated. [ 897.625443] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e5d90b2d-3f1f-430c-9459-a9a36aefacfa with status ACTIVE [ 897.625581] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.625714] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.625783] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.625996] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.626193] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.626353] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.626458] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.626520] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.626673] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.626750] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.626930] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.627034] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.627096] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.627236] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.627309] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.627391] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e5d90b2d-3f1f-430c-9459-a9a36aefacfa is going to be updated. [ 897.637394] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.637531] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.637610] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.637787] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.637911] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.638075] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-83db9863-6931-46e1-acf7-4fa3aa3bef88" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.647404] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.647571] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.647635] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.647828] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.647957] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.648128] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5d90b2d-3f1f-430c-9459-a9a36aefacfa" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.985770] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb in Status: SUCCESS [ 897.985955] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb deletion is rescheduled due to dependency. [ 897.986127] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.986297] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.986716] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.986973] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.987164] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.987277] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.987476] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.987594] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.987724] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.132012] env[66502]: INFO networking_nsxv3.common.synchronization [req-fe77de19-c859-401a-a5de-b402f1eb8057 req-15936bf2-0342-4c1a-8cf9-74271f4a9d32 tempest-SecurityGroupsTestJSON-779026578 tempest-SecurityGroupsTestJSON-779026578-project-member] Enqueued Resource ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d with Priority: HIGHEST for action security_group_members [ 898.132531] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d with Priority: HIGHEST for action security_group_members [ 898.134220] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.134356] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.134427] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.134625] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.134784] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.134879] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.134972] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.136351] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.136458] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.136570] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.491633] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.497914] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-342 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.497914] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-342" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.497914] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-342" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.497914] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-342" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.498190] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.498278] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.498476] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.498736] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.498881] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.499204] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 898.499341] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 898.499453] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 898.499559] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 898.499719] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 898.499911] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 898.500078] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 898.525370] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 898.525370] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 898.525370] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 898.525370] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-342" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.526279] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-3dfbda6c-14b7-4eff-a6d2-a50b2908e6f3 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.528497] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-3dfbda6c-14b7-4eff-a6d2-a50b2908e6f3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.528781] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-3dfbda6c-14b7-4eff-a6d2-a50b2908e6f3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.529246] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-3dfbda6c-14b7-4eff-a6d2-a50b2908e6f3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.529498] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3dfbda6c-14b7-4eff-a6d2-a50b2908e6f3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.622389] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 in Status: SUCCESS [ 898.622715] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.640662] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.996024] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.022171] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 in Status: SUCCESS [ 899.022171] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.022171] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.022171] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.022444] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.022521] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.022562] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.022743] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.022885] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.022990] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.034042] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.034042] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.034042] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.034042] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.034042] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.034042] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port 3dfbda6c-14b7-4eff-a6d2-a50b2908e6f3 not found, creating... [ 899.034574] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.034574] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.034719] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.034884] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.035107] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.035384] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.035548] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.035686] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.035937] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.041251] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.041439] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: 3dfbda6c-14b7-4eff-a6d2-a50b2908e6f3 is going to be created. [ 899.064881] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.065466] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.065466] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.065814] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.066140] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.066485] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-3dfbda6c-14b7-4eff-a6d2-a50b2908e6f3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.143588] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.498050] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.498233] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.498312] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.498571] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.498817] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.498817] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb is going to be updated. [ 899.525655] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.534658] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.535229] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.535311] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.535838] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.536010] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.548500] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb in Status: IN_PROGRESS for 2s [ 899.648189] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.648189] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.648189] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.648189] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.648189] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.648189] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d is going to be updated. [ 899.716213] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.716502] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.716583] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.716788] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.717136] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.729074] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d in Status: IN_PROGRESS for 2s [ 899.786461] env[66502]: INFO networking_nsxv3.common.synchronization [req-d2ad3a9f-6e9e-4f7f-ac74-b564a0555384 req-7b9ffe20-e767-4fa9-a631-5919d9b09f2d tempest-ListServerFiltersTestJSON-1482878491 tempest-ListServerFiltersTestJSON-1482878491-project-member] Enqueued Resource ID: b96da033-21f1-44bb-a822-a4cb59139771 with Priority: HIGHEST for action security_group_members [ 899.787070] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b96da033-21f1-44bb-a822-a4cb59139771 with Priority: HIGHEST for action security_group_members [ 899.788027] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b96da033-21f1-44bb-a822-a4cb59139771 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.788027] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.788027] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.788027] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.788027] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.788288] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.788288] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.788419] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.788675] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.788675] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b96da033-21f1-44bb-a822-a4cb59139771',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.810249] env[66502]: INFO networking_nsxv3.common.synchronization [req-fe77de19-c859-401a-a5de-b402f1eb8057 req-583588c4-02e1-4b1a-9f67-6b7f4a55c47d service nova] Enqueued Resource ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d with Priority: HIGHEST for action security_group_rules [ 899.810444] env[66502]: INFO networking_nsxv3.common.synchronization [req-fe77de19-c859-401a-a5de-b402f1eb8057 req-583588c4-02e1-4b1a-9f67-6b7f4a55c47d service nova] Enqueued Resource ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d with Priority: HIGHEST for action security_group_members [ 899.810553] env[66502]: INFO networking_nsxv3.common.synchronization [req-fe77de19-c859-401a-a5de-b402f1eb8057 req-583588c4-02e1-4b1a-9f67-6b7f4a55c47d service nova] Enqueued Resource ID: 3dfbda6c-14b7-4eff-a6d2-a50b2908e6f3 with Priority: HIGHEST for action port [ 899.811069] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d with Priority: HIGHEST for action security_group_rules [ 899.811195] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d with Priority: HIGHEST for action security_group_members [ 899.811391] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3dfbda6c-14b7-4eff-a6d2-a50b2908e6f3 with Priority: HIGHEST for action port [ 899.811613] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e5c2909-7671-4f4c-995e-cc0f19e2e48d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.811763] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.811847] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.812079] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.812171] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.813317] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.813421] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.813704] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-3dfbda6c-14b7-4eff-a6d2-a50b2908e6f3 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.813825] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3dfbda6c-14b7-4eff-a6d2-a50b2908e6f3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.813916] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3dfbda6c-14b7-4eff-a6d2-a50b2908e6f3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.815170] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3dfbda6c-14b7-4eff-a6d2-a50b2908e6f3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.815170] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3dfbda6c-14b7-4eff-a6d2-a50b2908e6f3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.028880] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.291669] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.291928] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.292075] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.292403] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.292556] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.292851] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.293109] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.293109] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.293350] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.293490] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.293630] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b96da033-21f1-44bb-a822-a4cb59139771 is going to be updated. [ 900.316817] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.316945] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.317076] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3dfbda6c-14b7-4eff-a6d2-a50b2908e6f3 with status ACTIVE [ 900.317306] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.317420] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.317420] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.318825] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.318825] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.318825] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.318825] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.318825] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.318825] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.318825] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.318825] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.318825] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.318825] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.318825] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.318825] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.319330] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3dfbda6c-14b7-4eff-a6d2-a50b2908e6f3 is going to be updated. [ 900.334584] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.334859] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.335040] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.335411] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.335682] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.348242] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b96da033-21f1-44bb-a822-a4cb59139771 in Status: IN_PROGRESS for 2s [ 900.358585] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.358585] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.358585] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.358789] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.358818] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.359375] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3dfbda6c-14b7-4eff-a6d2-a50b2908e6f3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.532246] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.534468] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.534468] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.534468] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.534468] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.534468] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 is going to be updated. [ 900.577803] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.577803] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.577803] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.577803] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.577803] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.587657] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 in Status: IN_PROGRESS for 2s [ 901.175147] env[66502]: INFO networking_nsxv3.common.synchronization [req-7319aea7-dcdb-4fc2-873e-d71128949552 req-0d762fa9-b63d-4355-b0c6-05b4281230ed tempest-ServersTestBootFromVolume-1686244991 tempest-ServersTestBootFromVolume-1686244991-project-member] Enqueued Resource ID: eeb100e3-e5a7-4d38-a030-42278dbe1366 with Priority: HIGHEST for action security_group_members [ 901.176598] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eeb100e3-e5a7-4d38-a030-42278dbe1366 with Priority: HIGHEST for action security_group_members [ 901.176789] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-eeb100e3-e5a7-4d38-a030-42278dbe1366 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.176924] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eeb100e3-e5a7-4d38-a030-42278dbe1366" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.176997] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eeb100e3-e5a7-4d38-a030-42278dbe1366" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.177252] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eeb100e3-e5a7-4d38-a030-42278dbe1366" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.177418] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.177524] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.177589] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.177745] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.177833] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.177933] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eeb100e3-e5a7-4d38-a030-42278dbe1366',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.561582] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb in Status: SUCCESS [ 901.561807] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.561981] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.562223] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.562417] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.562532] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.562599] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.562747] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.562828] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.562911] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.563007] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.680442] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.680580] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.680745] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.680982] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.705467] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.705730] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.706377] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.706377] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.706377] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.706377] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.706377] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eeb100e3-e5a7-4d38-a030-42278dbe1366 is going to be updated. [ 901.734511] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.734657] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.734657] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.734870] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.735304] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.738719] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d in Status: SUCCESS [ 901.738914] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.739080] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.739284] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.739458] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.739574] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.739641] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.739789] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.739867] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.739962] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.743768] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eeb100e3-e5a7-4d38-a030-42278dbe1366 in Status: IN_PROGRESS for 2s [ 902.066591] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-aba51398-48dc-4f5e-b3cf-1da4130d58fb taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.066803] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.066999] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.067100] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.067302] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.067435] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.067506] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.067612] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.067691] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.067785] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.067927] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-aba51398-48dc-4f5e-b3cf-1da4130d58fb taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.068066] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.068882] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.068882] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.068882] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.068882] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.068882] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.068882] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.068882] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.068882] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.068882] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.242929] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.263120] env[66502]: INFO networking_nsxv3.common.synchronization [req-b5ed475a-ac93-4b2a-ae4d-74e246a91084 req-31b5850d-85b3-46c3-8546-6add99e5eacb tempest-DeleteServersTestJSON-51385704 tempest-DeleteServersTestJSON-51385704-project-member] Enqueued Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_members [ 902.263120] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_members [ 902.263120] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-704e5eab-aa44-4493-8c9a-0b24250e7bea taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.263120] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.263120] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.263120] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.263120] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.263120] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.263120] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.263120] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.263120] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.263678] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.370801] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b96da033-21f1-44bb-a822-a4cb59139771 in Status: SUCCESS [ 902.370996] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b96da033-21f1-44bb-a822-a4cb59139771 deletion is rescheduled due to dependency. [ 902.371127] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b96da033-21f1-44bb-a822-a4cb59139771" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.575474] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aba51398-48dc-4f5e-b3cf-1da4130d58fb: rpc.has_security_group_logging(os_id): False [ 902.598648] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 in Status: SUCCESS [ 902.598648] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.598648] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.598779] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.598933] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.599063] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.599670] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.599670] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.599670] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.599670] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.599670] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.602036] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.602036] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.602036] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.602036] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.602036] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.602036] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.602036] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.602360] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.604121] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.604420] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.604716] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.604877] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.605644] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.605919] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.606071] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.606515] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.606857] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.607344] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.607478] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.609531] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.609749] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb is going to be updated. [ 902.610783] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.610954] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.611172] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.611278] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.611344] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.611536] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.611589] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.611749] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.625207] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-608 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.625207] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-608" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.625207] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-608" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.625207] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-608" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.625783] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.626108] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.626334] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.626637] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.626865] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.627209] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 902.627422] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 902.627608] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 902.627789] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 902.628063] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 902.628315] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 902.628590] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 902.653778] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 902.653778] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 902.653778] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 902.653778] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-608" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.653778] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-877aa5c7-aff6-4627-8c6e-1a81c8df4701 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.653778] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-877aa5c7-aff6-4627-8c6e-1a81c8df4701" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.653778] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-877aa5c7-aff6-4627-8c6e-1a81c8df4701" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.653778] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-877aa5c7-aff6-4627-8c6e-1a81c8df4701" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.653778] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('877aa5c7-aff6-4627-8c6e-1a81c8df4701',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.682312] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.683095] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.683095] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.683460] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.683522] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.699512] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb in Status: IN_PROGRESS for 2s [ 902.744816] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.766046] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.766046] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.766046] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.766359] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.766359] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.766550] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.766656] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.766720] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.766883] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.766961] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.767058] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea is going to be deleted. [ 902.809390] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.809547] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.809589] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.809798] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.809893] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.809995] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.115207] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.115207] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.115207] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.158026] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.158026] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.158026] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.158026] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.158026] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.158026] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 877aa5c7-aff6-4627-8c6e-1a81c8df4701 not found, creating... [ 903.158026] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.158026] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.158026] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.158026] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.158026] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.158495] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.158495] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.158840] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.159288] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.159597] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.159881] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 877aa5c7-aff6-4627-8c6e-1a81c8df4701 is going to be created. [ 903.184157] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.184364] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.184477] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.185721] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.185721] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.185721] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-877aa5c7-aff6-4627-8c6e-1a81c8df4701" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.247365] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.247797] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.247797] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.247895] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.247950] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.248070] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d is going to be updated. [ 903.305762] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.305966] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.306122] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.306971] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.306971] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.318830] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d in Status: IN_PROGRESS for 2s [ 903.616877] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.756209] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eeb100e3-e5a7-4d38-a030-42278dbe1366 in Status: SUCCESS [ 903.756209] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eeb100e3-e5a7-4d38-a030-42278dbe1366 deletion is rescheduled due to dependency. [ 903.756209] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eeb100e3-e5a7-4d38-a030-42278dbe1366" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.915018] env[66502]: INFO networking_nsxv3.common.synchronization [req-b5ed475a-ac93-4b2a-ae4d-74e246a91084 req-9b277ba4-ff74-437e-826e-e66ae1597e92 service nova] Enqueued Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_rules [ 903.915018] env[66502]: INFO networking_nsxv3.common.synchronization [req-b5ed475a-ac93-4b2a-ae4d-74e246a91084 req-9b277ba4-ff74-437e-826e-e66ae1597e92 service nova] Enqueued Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_members [ 903.915018] env[66502]: INFO networking_nsxv3.common.synchronization [req-b5ed475a-ac93-4b2a-ae4d-74e246a91084 req-9b277ba4-ff74-437e-826e-e66ae1597e92 service nova] Enqueued Resource ID: 877aa5c7-aff6-4627-8c6e-1a81c8df4701 with Priority: HIGHEST for action port [ 903.915648] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_rules [ 903.917307] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_members [ 903.917307] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 877aa5c7-aff6-4627-8c6e-1a81c8df4701 with Priority: HIGHEST for action port [ 903.917307] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-704e5eab-aa44-4493-8c9a-0b24250e7bea taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.917307] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.917307] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.918016] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.918184] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.919175] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-704e5eab-aa44-4493-8c9a-0b24250e7bea taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.919296] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.919364] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.919544] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.919690] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.919784] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.919843] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.920573] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.920740] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.920875] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.921768] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-877aa5c7-aff6-4627-8c6e-1a81c8df4701 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.921942] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-877aa5c7-aff6-4627-8c6e-1a81c8df4701" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.922055] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-877aa5c7-aff6-4627-8c6e-1a81c8df4701" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.922851] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-877aa5c7-aff6-4627-8c6e-1a81c8df4701" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.922851] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('877aa5c7-aff6-4627-8c6e-1a81c8df4701',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.119159] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.119338] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.119438] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.119633] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.119723] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.119818] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 is going to be updated. [ 904.242987] env[66502]: INFO networking_nsxv3.common.synchronization [req-bb72c904-71b8-406c-a9d6-07a2750024a2 req-b79cc527-f546-482e-b018-fc628ebd044b tempest-ServersAdminTestJSON-292997046 tempest-ServersAdminTestJSON-292997046-project-member] Enqueued Resource ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 with Priority: HIGHEST for action security_group_members [ 904.243881] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 with Priority: HIGHEST for action security_group_members [ 904.247021] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.247021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.247021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.247021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.247021] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.247021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.247021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.247021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.247021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.247021] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.263376] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.263520] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.263591] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.263797] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.263939] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.281241] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 in Status: IN_PROGRESS for 2s [ 904.426897] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.427983] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-704e5eab-aa44-4493-8c9a-0b24250e7bea taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.428104] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.428266] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 877aa5c7-aff6-4627-8c6e-1a81c8df4701 with status ACTIVE [ 904.428465] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.428569] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.428615] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.433016] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.433016] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.433016] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.433016] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.433016] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.433016] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.433016] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.433016] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.433016] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.433016] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.433016] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.433016] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.433016] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 877aa5c7-aff6-4627-8c6e-1a81c8df4701 is going to be updated. [ 904.456231] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.456231] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.456231] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.456382] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.456711] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.456711] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-877aa5c7-aff6-4627-8c6e-1a81c8df4701" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.566862] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-8 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.567070] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.567240] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.567514] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.567776] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.567935] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.568106] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.568273] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.568448] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.568626] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 904.568736] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 904.568844] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 904.568949] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 904.569069] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 904.569177] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 904.569325] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 904.592844] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 904.593020] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 904.593162] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 904.593336] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.593682] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-f7755990-4338-41d6-9db5-fbee821cf28f taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.593843] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-f7755990-4338-41d6-9db5-fbee821cf28f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.593959] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-f7755990-4338-41d6-9db5-fbee821cf28f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.594373] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-f7755990-4338-41d6-9db5-fbee821cf28f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.594512] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7755990-4338-41d6-9db5-fbee821cf28f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.732035] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb in Status: SUCCESS [ 904.732035] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.746896] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.933989] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.097114] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.097460] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.097542] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.097815] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.097966] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.098141] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port f7755990-4338-41d6-9db5-fbee821cf28f not found, creating... [ 905.098403] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.098609] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.098731] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.098949] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.099103] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.099420] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.100169] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.100169] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.100169] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.100169] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.100169] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: f7755990-4338-41d6-9db5-fbee821cf28f is going to be created. [ 905.120838] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.121095] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.121228] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.121585] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.121819] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.122113] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-f7755990-4338-41d6-9db5-fbee821cf28f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.250214] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.328571] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d in Status: SUCCESS [ 905.328829] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.329107] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.329184] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.329517] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.329517] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.329713] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.329759] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.329841] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.329928] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.330042] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.437343] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.437602] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.437720] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.437965] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.438092] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.438206] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea is going to be created. [ 905.468100] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.468324] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.468460] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.468736] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.469257] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.483398] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: UNINITIALIZED for 2s [ 905.752962] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.753206] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.753206] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.753415] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.753509] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.753611] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 is going to be updated. [ 905.800523] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.800754] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.800754] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.802057] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.802057] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.812351] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 in Status: IN_PROGRESS for 2s [ 905.833293] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.833492] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.833568] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.834295] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.834295] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.834295] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.834295] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.834737] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.834737] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.834840] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.834989] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.835093] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.835160] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.835307] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.835448] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.835563] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.835626] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.835766] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.835842] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.835921] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.836201] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.867238] env[66502]: INFO networking_nsxv3.common.synchronization [req-bb72c904-71b8-406c-a9d6-07a2750024a2 req-1a2cb598-0c32-4483-917d-e61cee1d817c service nova] Enqueued Resource ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 with Priority: HIGHEST for action security_group_rules [ 905.867238] env[66502]: INFO networking_nsxv3.common.synchronization [req-bb72c904-71b8-406c-a9d6-07a2750024a2 req-1a2cb598-0c32-4483-917d-e61cee1d817c service nova] Enqueued Resource ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 with Priority: HIGHEST for action security_group_members [ 905.867238] env[66502]: INFO networking_nsxv3.common.synchronization [req-bb72c904-71b8-406c-a9d6-07a2750024a2 req-1a2cb598-0c32-4483-917d-e61cee1d817c service nova] Enqueued Resource ID: f7755990-4338-41d6-9db5-fbee821cf28f with Priority: HIGHEST for action port [ 905.867904] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 with Priority: HIGHEST for action security_group_rules [ 905.868088] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 with Priority: HIGHEST for action security_group_members [ 905.868268] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7755990-4338-41d6-9db5-fbee821cf28f with Priority: HIGHEST for action port [ 905.868690] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee2e9577-19ff-440d-9bd8-24dbaf88ea24 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.869086] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.869086] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.869086] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.869217] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.870127] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.870276] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.870446] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-f7755990-4338-41d6-9db5-fbee821cf28f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.870625] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f7755990-4338-41d6-9db5-fbee821cf28f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.870732] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f7755990-4338-41d6-9db5-fbee821cf28f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.870930] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f7755990-4338-41d6-9db5-fbee821cf28f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.871047] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f7755990-4338-41d6-9db5-fbee821cf28f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.299897] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 in Status: SUCCESS [ 906.300191] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.300669] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.300904] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.301109] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.301229] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.301296] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.301519] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.301615] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.301702] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.301868] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.301981] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.306098] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.306510] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.306736] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.306866] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.306934] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.307120] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.307215] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.307505] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.307616] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.312113] env[66502]: INFO networking_nsxv3.common.synchronization [req-338eb217-1894-4042-8f2e-b48ff7e3dbb3 req-33c0a65a-d7c1-4b13-9504-b995a586d414 tempest-ImagesTestJSON-1088460097 tempest-ImagesTestJSON-1088460097-project-member] Enqueued Resource ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 with Priority: HIGHEST for action security_group_members [ 906.312113] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 with Priority: HIGHEST for action security_group_members [ 906.312113] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.312113] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.312113] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.312113] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.312570] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.312570] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.312570] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.313083] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.313173] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.313268] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.340110] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e5c2909-7671-4f4c-995e-cc0f19e2e48d: rpc.has_security_group_logging(os_id): False [ 906.369713] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.369846] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.369946] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.370210] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.370334] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.370472] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.370572] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.370647] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.370892] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.370892] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.371115] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.371217] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.371277] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.371457] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.371555] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.371728] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.371875] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.371982] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.372195] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.372295] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.372401] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d is going to be updated. [ 906.373890] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.374115] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.374348] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f7755990-4338-41d6-9db5-fbee821cf28f with status ACTIVE [ 906.374563] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.374659] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.374724] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.374923] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.374988] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.375166] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.375261] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.375329] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.375499] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.375575] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.375754] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.375846] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.375904] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.376290] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.376387] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.376447] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f7755990-4338-41d6-9db5-fbee821cf28f is going to be updated. [ 906.429044] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.429044] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.429393] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.429393] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.429813] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.429813] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f7755990-4338-41d6-9db5-fbee821cf28f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.561269] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.561269] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.561269] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.561445] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.563784] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.634487] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d in Status: IN_PROGRESS for 2s [ 906.697852] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-545 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.698276] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-545" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.698513] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-545" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.698910] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-545" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.699313] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.699626] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.699844] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.700180] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.700697] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.701029] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 906.701270] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 906.701694] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 906.701694] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 906.701931] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 906.703825] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 906.703825] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 906.734214] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 906.734496] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 906.734652] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 906.734903] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-545" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.735280] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-ee511240-40fe-4980-9835-a702c3b4cdad taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.735753] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-ee511240-40fe-4980-9835-a702c3b4cdad" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.735753] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-ee511240-40fe-4980-9835-a702c3b4cdad" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.736019] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-ee511240-40fe-4980-9835-a702c3b4cdad" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.736596] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee511240-40fe-4980-9835-a702c3b4cdad',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.810451] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0bae9bdb-dcb4-4110-bcb0-1b0548a94738: rpc.has_security_group_logging(os_id): False [ 906.819409] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.836698] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.836852] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.836923] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.837213] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.837355] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.837604] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.837742] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.837785] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.837950] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.838041] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.838247] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.838405] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.838525] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.838848] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.838848] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.838987] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.839292] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.839370] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.839526] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.839595] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.839684] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 is going to be updated. [ 906.952349] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.954457] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.954457] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.954457] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.954457] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.969301] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 in Status: IN_PROGRESS for 2s [ 907.240488] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.240488] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.240737] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.241014] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.241246] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.241387] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port ee511240-40fe-4980-9835-a702c3b4cdad not found, creating... [ 907.241663] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.241839] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.241961] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.242231] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.242395] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.242722] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.242893] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.243018] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.243274] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.243413] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.243574] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: ee511240-40fe-4980-9835-a702c3b4cdad is going to be created. [ 907.272066] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.272351] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.272510] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.272892] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.273204] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.273505] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-ee511240-40fe-4980-9835-a702c3b4cdad" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.322463] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.498501] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: SUCCESS [ 907.498830] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.499135] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.499411] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.502060] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.502060] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.502060] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.502060] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.502060] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.502060] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.502060] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.822765] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 in Status: SUCCESS [ 907.823547] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.823547] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.823718] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.823807] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.823933] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.824042] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.824314] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.824404] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.824551] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.825595] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.825739] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.825791] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.825929] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.826069] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.826194] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 is going to be updated. [ 907.863574] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.863574] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.863574] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.863840] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.864164] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.875682] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 in Status: IN_PROGRESS for 2s [ 907.992529] env[66502]: INFO networking_nsxv3.common.synchronization [req-338eb217-1894-4042-8f2e-b48ff7e3dbb3 req-0e336e9c-627a-4d21-9553-2c526af36fac service nova] Enqueued Resource ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 with Priority: HIGHEST for action security_group_rules [ 907.992813] env[66502]: INFO networking_nsxv3.common.synchronization [req-338eb217-1894-4042-8f2e-b48ff7e3dbb3 req-0e336e9c-627a-4d21-9553-2c526af36fac service nova] Enqueued Resource ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 with Priority: HIGHEST for action security_group_members [ 907.992970] env[66502]: INFO networking_nsxv3.common.synchronization [req-338eb217-1894-4042-8f2e-b48ff7e3dbb3 req-0e336e9c-627a-4d21-9553-2c526af36fac service nova] Enqueued Resource ID: ee511240-40fe-4980-9835-a702c3b4cdad with Priority: HIGHEST for action port [ 907.993730] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 with Priority: HIGHEST for action security_group_rules [ 907.993900] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 with Priority: HIGHEST for action security_group_members [ 907.994090] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee511240-40fe-4980-9835-a702c3b4cdad with Priority: HIGHEST for action port [ 907.994452] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.994803] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.994803] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.994923] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.995056] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 907.996012] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.996140] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.996380] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-ee511240-40fe-4980-9835-a702c3b4cdad taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.996490] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ee511240-40fe-4980-9835-a702c3b4cdad" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.996556] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ee511240-40fe-4980-9835-a702c3b4cdad" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.996743] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ee511240-40fe-4980-9835-a702c3b4cdad" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.996820] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ee511240-40fe-4980-9835-a702c3b4cdad',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.003875] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-704e5eab-aa44-4493-8c9a-0b24250e7bea taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.004162] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.004162] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.005160] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.005160] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.005509] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.005588] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.005778] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.005922] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.006037] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.006246] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-704e5eab-aa44-4493-8c9a-0b24250e7bea taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.006344] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.006405] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.006554] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.006697] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.006812] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.006898] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.007162] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.007208] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.007282] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.007376] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.328501] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.500513] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.500513] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.500513] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ee511240-40fe-4980-9835-a702c3b4cdad with status ACTIVE [ 908.500513] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.500513] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.500513] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.500513] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.500513] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.500513] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.501318] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.501318] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.501318] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.501318] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.501318] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.501318] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.501318] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.501318] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.501625] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.501625] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ee511240-40fe-4980-9835-a702c3b4cdad is going to be updated. [ 908.510272] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 704e5eab-aa44-4493-8c9a-0b24250e7bea: rpc.has_security_group_logging(os_id): False [ 908.531079] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.531186] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.531258] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.531513] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.531712] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.532014] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ee511240-40fe-4980-9835-a702c3b4cdad" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.534779] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.534926] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.534998] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.535926] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.535926] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.535926] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.535926] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.536194] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.536651] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.536651] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.536838] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.536960] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.537032] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.537294] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.537381] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.537531] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.537634] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.537691] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.537869] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.537957] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.538269] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea is going to be created. [ 908.618178] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.618305] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.618340] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.618886] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.618886] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.657640] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: IN_PROGRESS for 2s [ 908.668890] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d in Status: SUCCESS [ 908.669175] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.831939] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 908.985586] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 in Status: SUCCESS [ 908.985801] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.985971] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.986262] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.986364] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.337579] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.337579] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.337579] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.337579] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.337579] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.337579] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 is going to be updated. [ 909.373272] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.373492] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.373565] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.373784] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.375252] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.384700] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 in Status: IN_PROGRESS for 2s [ 909.489323] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.489494] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.489563] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.489783] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.489956] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.490077] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.490145] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.490294] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.490387] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.490557] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.490655] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.891843] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 in Status: SUCCESS [ 909.891843] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.891843] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.891843] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.891843] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.891843] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.891843] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.891843] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.891843] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.891843] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.992558] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.992780] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.992837] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.994067] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.994067] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.994067] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.994067] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.994067] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.994067] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.994067] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.994067] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.994067] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.994067] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.994572] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.994572] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.994572] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.994572] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.994900] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.994900] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.994900] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.995081] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.112835] env[66502]: INFO networking_nsxv3.common.synchronization [req-d5a89ad6-7bad-4c52-95ec-c78693b8d614 req-3254188c-38da-45a2-8038-b5815327e020 tempest-ServerGroupTestJSON-1641290138 tempest-ServerGroupTestJSON-1641290138-project-member] Enqueued Resource ID: 2b94d044-5ce0-4270-aced-c26d396494bc with Priority: HIGHEST for action security_group_members [ 910.113523] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b94d044-5ce0-4270-aced-c26d396494bc with Priority: HIGHEST for action security_group_members [ 910.113894] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b94d044-5ce0-4270-aced-c26d396494bc taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.114237] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b94d044-5ce0-4270-aced-c26d396494bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.114338] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b94d044-5ce0-4270-aced-c26d396494bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.114748] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b94d044-5ce0-4270-aced-c26d396494bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.114841] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.114962] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.115039] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.115224] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.115367] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.115479] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b94d044-5ce0-4270-aced-c26d396494bc',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.395648] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.500261] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0bae9bdb-dcb4-4110-bcb0-1b0548a94738: rpc.has_security_group_logging(os_id): False [ 910.523818] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.523818] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.523818] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.524431] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.524431] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.524431] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.524570] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.524570] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.524717] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.524787] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.524985] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.525095] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.525159] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.525302] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.525374] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.525565] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.525664] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.525788] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.525856] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.525945] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.526018] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 is going to be updated. [ 910.623420] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.623420] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.623420] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.623420] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.623420] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.623420] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.623420] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.623420] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.623420] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.623420] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.623420] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b94d044-5ce0-4270-aced-c26d396494bc already deleted. [ 910.623420] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b94d044-5ce0-4270-aced-c26d396494bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.636285] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.636285] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.636285] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.636285] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.636285] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.653808] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-41 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.653808] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-41" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.653808] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-41" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.653808] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-41" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.653808] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.653808] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.654991] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.654991] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.654991] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.654991] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 910.655430] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 910.655430] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 910.655604] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 910.655820] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 910.655992] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 910.656350] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 910.682433] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 in Status: IN_PROGRESS for 2s [ 910.706379] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 910.706379] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.049 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 910.706379] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 910.706379] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-41" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.706379] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-038b169a-5d28-4fc1-9123-99e582907230 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.706379] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-038b169a-5d28-4fc1-9123-99e582907230" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.706860] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-038b169a-5d28-4fc1-9123-99e582907230" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.706951] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-038b169a-5d28-4fc1-9123-99e582907230" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.707172] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('038b169a-5d28-4fc1-9123-99e582907230',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 910.719871] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: SUCCESS [ 910.719871] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.897082] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.211036] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.211399] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.211578] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.211933] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.212123] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.212346] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port 038b169a-5d28-4fc1-9123-99e582907230 not found, creating... [ 911.212692] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.212899] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.213033] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.213323] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.213505] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.213813] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.214034] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.214192] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.214429] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.214573] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.214742] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: 038b169a-5d28-4fc1-9123-99e582907230 is going to be created. [ 911.244078] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.244527] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.244728] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.245055] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.245278] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.245554] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-038b169a-5d28-4fc1-9123-99e582907230" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.294043] env[66502]: INFO networking_nsxv3.common.synchronization [req-3c63eff1-8f8e-4fd0-b4a1-892131462767 req-d5a95271-6cb9-40c2-a906-584308c01085 tempest-SecurityGroupsTestJSON-779026578 tempest-SecurityGroupsTestJSON-779026578-project-member] Enqueued Resource ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d with Priority: HIGHEST for action security_group_members [ 911.294043] env[66502]: INFO networking_nsxv3.common.synchronization [req-3c63eff1-8f8e-4fd0-b4a1-892131462767 req-d5a95271-6cb9-40c2-a906-584308c01085 tempest-SecurityGroupsTestJSON-779026578 tempest-SecurityGroupsTestJSON-779026578-project-member] Enqueued Resource ID: f33bcef8-0b06-4301-b08b-ba4a7cd9e47a with Priority: HIGHEST for action security_group_members [ 911.294043] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d with Priority: HIGHEST for action security_group_members [ 911.294043] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f33bcef8-0b06-4301-b08b-ba4a7cd9e47a with Priority: HIGHEST for action security_group_members [ 911.294308] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.294474] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.294604] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.294858] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.295122] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.295207] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.295324] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.295635] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.295635] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.295736] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.297220] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.297341] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.297419] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.297812] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.297998] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.298133] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.298200] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.298363] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.298451] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.298545] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f33bcef8-0b06-4301-b08b-ba4a7cd9e47a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.341443] env[66502]: INFO networking_nsxv3.common.synchronization [req-3c63eff1-8f8e-4fd0-b4a1-892131462767 req-d5a95271-6cb9-40c2-a906-584308c01085 tempest-SecurityGroupsTestJSON-779026578 tempest-SecurityGroupsTestJSON-779026578-project-member] Enqueued Resource ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d with Priority: HIGHEST for action security_group_rules [ 911.341633] env[66502]: INFO networking_nsxv3.common.synchronization [req-3c63eff1-8f8e-4fd0-b4a1-892131462767 req-d5a95271-6cb9-40c2-a906-584308c01085 tempest-SecurityGroupsTestJSON-779026578 tempest-SecurityGroupsTestJSON-779026578-project-member] Enqueued Resource ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d with Priority: HIGHEST for action security_group_members [ 911.341749] env[66502]: INFO networking_nsxv3.common.synchronization [req-3c63eff1-8f8e-4fd0-b4a1-892131462767 req-d5a95271-6cb9-40c2-a906-584308c01085 tempest-SecurityGroupsTestJSON-779026578 tempest-SecurityGroupsTestJSON-779026578-project-member] Enqueued Resource ID: f33bcef8-0b06-4301-b08b-ba4a7cd9e47a with Priority: HIGHEST for action security_group_rules [ 911.341870] env[66502]: INFO networking_nsxv3.common.synchronization [req-3c63eff1-8f8e-4fd0-b4a1-892131462767 req-d5a95271-6cb9-40c2-a906-584308c01085 tempest-SecurityGroupsTestJSON-779026578 tempest-SecurityGroupsTestJSON-779026578-project-member] Enqueued Resource ID: f33bcef8-0b06-4301-b08b-ba4a7cd9e47a with Priority: HIGHEST for action security_group_members [ 911.341995] env[66502]: INFO networking_nsxv3.common.synchronization [req-3c63eff1-8f8e-4fd0-b4a1-892131462767 req-d5a95271-6cb9-40c2-a906-584308c01085 tempest-SecurityGroupsTestJSON-779026578 tempest-SecurityGroupsTestJSON-779026578-project-member] Enqueued Resource ID: 3dfbda6c-14b7-4eff-a6d2-a50b2908e6f3 with Priority: HIGHEST for action port [ 911.342728] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d with Priority: HIGHEST for action security_group_rules [ 911.342891] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f33bcef8-0b06-4301-b08b-ba4a7cd9e47a with Priority: HIGHEST for action security_group_rules [ 911.343017] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3dfbda6c-14b7-4eff-a6d2-a50b2908e6f3 with Priority: HIGHEST for action port [ 911.343129] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d with Priority: HIGHEST for action security_group_members [ 911.343216] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f33bcef8-0b06-4301-b08b-ba4a7cd9e47a with Priority: HIGHEST for action security_group_members [ 911.343523] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e5c2909-7671-4f4c-995e-cc0f19e2e48d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.343656] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.343736] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.343951] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.344048] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.345334] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.345517] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.345621] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.345885] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.345966] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f33bcef8-0b06-4301-b08b-ba4a7cd9e47a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.347181] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-3dfbda6c-14b7-4eff-a6d2-a50b2908e6f3 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.347300] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3dfbda6c-14b7-4eff-a6d2-a50b2908e6f3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.347373] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3dfbda6c-14b7-4eff-a6d2-a50b2908e6f3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.347561] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3dfbda6c-14b7-4eff-a6d2-a50b2908e6f3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.347641] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3dfbda6c-14b7-4eff-a6d2-a50b2908e6f3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.348479] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.348569] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.348774] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.348857] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.399072] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 in Status: SUCCESS [ 911.399418] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.399926] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.399926] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.400608] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.400795] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.400881] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.401081] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.401170] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.401262] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.401359] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.404430] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.404430] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.404430] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.404898] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.405170] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.405342] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 is going to be updated. [ 911.450290] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.450489] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.450624] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.450764] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.450911] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.463506] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 in Status: IN_PROGRESS for 2s [ 911.799253] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.800491] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f33bcef8-0b06-4301-b08b-ba4a7cd9e47a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.850466] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3dfbda6c-14b7-4eff-a6d2-a50b2908e6f3 with status ACTIVE [ 911.850598] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.850731] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.850799] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.852085] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.852085] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.852085] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.852085] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.852085] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.852085] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.852085] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.852085] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.852085] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.852085] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.852085] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.852853] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.852853] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3dfbda6c-14b7-4eff-a6d2-a50b2908e6f3 is going to be updated. [ 911.853394] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.853499] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.853696] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.853778] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.874920] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.875137] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.875207] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.875410] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.875561] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.875700] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3dfbda6c-14b7-4eff-a6d2-a50b2908e6f3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.906965] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.908340] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.908340] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.908340] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.908340] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.908340] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.908340] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.908340] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.908340] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.908340] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.908703] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.908703] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.908703] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.908809] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.908899] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.909009] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.909077] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.909728] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.909728] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.909728] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.909728] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.937580] env[66502]: INFO networking_nsxv3.common.synchronization [req-dc566537-581c-411c-953a-25665be8181e req-8d5b6a5d-695b-4f07-b6e5-076ee5acff15 tempest-ImagesOneServerNegativeTestJSON-1621881971 tempest-ImagesOneServerNegativeTestJSON-1621881971-project-member] Enqueued Resource ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 with Priority: HIGHEST for action security_group_members [ 911.942945] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 with Priority: HIGHEST for action security_group_members [ 911.944421] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.944421] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.944421] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.944421] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.944421] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.945181] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.945181] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.945181] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.945181] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.945181] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ddb3b9a8-c63d-4123-aa7f-cbf2b5279231',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.061105] env[66502]: INFO networking_nsxv3.common.synchronization [req-d5a89ad6-7bad-4c52-95ec-c78693b8d614 req-e2c86e3d-cb65-48f2-8535-84441681423c service nova] Enqueued Resource ID: 2b94d044-5ce0-4270-aced-c26d396494bc with Priority: HIGHEST for action security_group_rules [ 912.061339] env[66502]: INFO networking_nsxv3.common.synchronization [req-d5a89ad6-7bad-4c52-95ec-c78693b8d614 req-e2c86e3d-cb65-48f2-8535-84441681423c service nova] Enqueued Resource ID: 2b94d044-5ce0-4270-aced-c26d396494bc with Priority: HIGHEST for action security_group_members [ 912.061528] env[66502]: INFO networking_nsxv3.common.synchronization [req-d5a89ad6-7bad-4c52-95ec-c78693b8d614 req-e2c86e3d-cb65-48f2-8535-84441681423c service nova] Enqueued Resource ID: 038b169a-5d28-4fc1-9123-99e582907230 with Priority: HIGHEST for action port [ 912.062078] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b94d044-5ce0-4270-aced-c26d396494bc with Priority: HIGHEST for action security_group_rules [ 912.062234] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b94d044-5ce0-4270-aced-c26d396494bc with Priority: HIGHEST for action security_group_members [ 912.062623] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 038b169a-5d28-4fc1-9123-99e582907230 with Priority: HIGHEST for action port [ 912.062981] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b94d044-5ce0-4270-aced-c26d396494bc taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.063402] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b94d044-5ce0-4270-aced-c26d396494bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.063519] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b94d044-5ce0-4270-aced-c26d396494bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.063811] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b94d044-5ce0-4270-aced-c26d396494bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.063898] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b94d044-5ce0-4270-aced-c26d396494bc',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.065446] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b94d044-5ce0-4270-aced-c26d396494bc taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.065565] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b94d044-5ce0-4270-aced-c26d396494bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.065768] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b94d044-5ce0-4270-aced-c26d396494bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.065979] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b94d044-5ce0-4270-aced-c26d396494bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.066499] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.067062] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.067141] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.067313] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.067404] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.067502] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b94d044-5ce0-4270-aced-c26d396494bc',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.069756] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-038b169a-5d28-4fc1-9123-99e582907230 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.069863] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-038b169a-5d28-4fc1-9123-99e582907230" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.069950] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-038b169a-5d28-4fc1-9123-99e582907230" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.072136] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-038b169a-5d28-4fc1-9123-99e582907230" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.072136] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('038b169a-5d28-4fc1-9123-99e582907230',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.301635] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.306508] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f33bcef8-0b06-4301-b08b-ba4a7cd9e47a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.416913] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ee2e9577-19ff-440d-9bd8-24dbaf88ea24: rpc.has_security_group_logging(os_id): False [ 912.421038] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-885 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.421038] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-885" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.421038] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-885" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.421362] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-885" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.421587] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.421795] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.421928] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.422187] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.422333] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.422984] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 912.422984] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 912.422984] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 912.422984] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 912.422984] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 912.423309] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 912.423309] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 912.442507] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.442695] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.443283] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.443283] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.443283] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.443454] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.443539] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.443592] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.443793] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.443900] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.444240] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.444378] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.444502] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.444628] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.444974] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.444974] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.445135] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.445135] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.445390] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.445448] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.445490] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 is going to be updated. [ 912.447737] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 912.447875] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 912.447998] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 912.448170] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-885" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.448477] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-59dedfe4-c20a-4e77-9a2d-c629ce5a90a5 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.448953] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-59dedfe4-c20a-4e77-9a2d-c629ce5a90a5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.448953] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-59dedfe4-c20a-4e77-9a2d-c629ce5a90a5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.449044] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-59dedfe4-c20a-4e77-9a2d-c629ce5a90a5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.449181] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59dedfe4-c20a-4e77-9a2d-c629ce5a90a5',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.451387] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.451387] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.451387] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.451387] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.451387] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.451387] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.451387] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.452017] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.452017] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.452017] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.452017] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 is going to be updated. [ 912.491603] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.491858] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.491919] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.492288] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.492815] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.505918] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 in Status: IN_PROGRESS for 2s [ 912.531779] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.531948] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.532033] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.532256] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.532404] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.555581] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 in Status: IN_PROGRESS for 2s [ 912.566645] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b94d044-5ce0-4270-aced-c26d396494bc taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.566883] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b94d044-5ce0-4270-aced-c26d396494bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.570267] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2b94d044-5ce0-4270-aced-c26d396494bc',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.575627] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 038b169a-5d28-4fc1-9123-99e582907230 with status ACTIVE [ 912.576120] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.576120] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.576120] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.576419] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.576455] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.576749] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.576749] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.576867] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.577363] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.577363] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.577363] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.577363] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.577363] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.577698] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.577698] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.577780] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 038b169a-5d28-4fc1-9123-99e582907230 is going to be updated. [ 912.607550] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.607711] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.607779] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.608400] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.608665] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.609026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-038b169a-5d28-4fc1-9123-99e582907230" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.722657] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 in Status: SUCCESS [ 912.722657] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.788843] env[66502]: INFO networking_nsxv3.common.synchronization [req-f587b9d0-db83-44e5-a8a9-3c118615f8b9 req-1d0ee0f8-39a2-4027-a92e-ade4bf019dac tempest-ServersTestMultiNic-1258705533 tempest-ServersTestMultiNic-1258705533-project-member] Enqueued Resource ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 with Priority: HIGHEST for action security_group_members [ 912.789441] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 with Priority: HIGHEST for action security_group_members [ 912.789867] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.790154] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.790360] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.790728] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.791044] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.791291] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.791487] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.791792] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.792023] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.792249] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.803733] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.803993] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.804124] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.804454] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.804609] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.804783] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d is going to be updated. [ 912.808336] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.808576] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.808759] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.809129] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.809407] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.809638] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f33bcef8-0b06-4301-b08b-ba4a7cd9e47a is going to be created. [ 912.838031] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.838274] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.838391] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.838667] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.838877] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.841901] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.842093] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.842234] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.842497] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.842762] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.853843] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d in Status: IN_PROGRESS for 2s [ 912.854788] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f33bcef8-0b06-4301-b08b-ba4a7cd9e47a in Status: UNINITIALIZED for 2s [ 912.955188] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.955529] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.955691] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.956098] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.956328] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.956584] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port 59dedfe4-c20a-4e77-9a2d-c629ce5a90a5 not found, creating... [ 912.956916] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.957114] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.957240] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.957495] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.957637] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.957975] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.958167] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.958351] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.958603] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.958750] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.958937] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: 59dedfe4-c20a-4e77-9a2d-c629ce5a90a5 is going to be created. [ 912.986186] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.986186] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.986186] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.986591] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.986873] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.987112] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-59dedfe4-c20a-4e77-9a2d-c629ce5a90a5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.072174] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2b94d044-5ce0-4270-aced-c26d396494bc',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.294710] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.319926] env[66502]: INFO networking_nsxv3.common.synchronization [req-f587b9d0-db83-44e5-a8a9-3c118615f8b9 req-dfef99cd-ba64-4bcc-96c5-19e837cf233b tempest-ServersTestMultiNic-1258705533 tempest-ServersTestMultiNic-1258705533-project-member] Enqueued Resource ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 with Priority: HIGHEST for action security_group_members [ 913.320546] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 with Priority: HIGHEST for action security_group_members [ 913.320871] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.321529] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.477019] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 in Status: SUCCESS [ 913.477019] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.477019] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.477019] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.477019] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.477019] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.477019] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.477019] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.477019] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.477019] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.477019] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.574755] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.574902] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.575431] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.575431] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.575431] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.575575] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b94d044-5ce0-4270-aced-c26d396494bc is going to be created. [ 913.604764] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.604973] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.605060] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.605278] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.605437] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.620329] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b94d044-5ce0-4270-aced-c26d396494bc in Status: UNINITIALIZED for 2s [ 913.685750] env[66502]: INFO networking_nsxv3.common.synchronization [req-dc566537-581c-411c-953a-25665be8181e req-7ee81a7e-2f25-406d-b89c-639fd6211905 service nova] Enqueued Resource ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 with Priority: HIGHEST for action security_group_rules [ 913.685750] env[66502]: INFO networking_nsxv3.common.synchronization [req-dc566537-581c-411c-953a-25665be8181e req-7ee81a7e-2f25-406d-b89c-639fd6211905 service nova] Enqueued Resource ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 with Priority: HIGHEST for action security_group_members [ 913.686359] env[66502]: INFO networking_nsxv3.common.synchronization [req-dc566537-581c-411c-953a-25665be8181e req-7ee81a7e-2f25-406d-b89c-639fd6211905 service nova] Enqueued Resource ID: 59dedfe4-c20a-4e77-9a2d-c629ce5a90a5 with Priority: HIGHEST for action port [ 913.687664] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 with Priority: HIGHEST for action security_group_rules [ 913.687664] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 with Priority: HIGHEST for action security_group_members [ 913.687664] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 59dedfe4-c20a-4e77-9a2d-c629ce5a90a5 with Priority: HIGHEST for action port [ 913.687664] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.687664] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.687664] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.688290] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.688290] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ddb3b9a8-c63d-4123-aa7f-cbf2b5279231',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.688843] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.689014] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.689150] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-59dedfe4-c20a-4e77-9a2d-c629ce5a90a5 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.689255] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-59dedfe4-c20a-4e77-9a2d-c629ce5a90a5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.689428] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-59dedfe4-c20a-4e77-9a2d-c629ce5a90a5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.689532] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-59dedfe4-c20a-4e77-9a2d-c629ce5a90a5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.689645] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('59dedfe4-c20a-4e77-9a2d-c629ce5a90a5',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.798731] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.979963] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.980260] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.980260] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.980894] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.981113] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.981236] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.981303] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.981478] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.982054] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.982054] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.982054] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.982054] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.982264] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.982264] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.982373] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.982465] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.982526] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.982668] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.982751] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.982831] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.982940] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.197024] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 59dedfe4-c20a-4e77-9a2d-c629ce5a90a5 with status ACTIVE [ 914.197024] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.197024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.197024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.197024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.197024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.197024] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.197024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.197024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.197024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.197024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.197024] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.197024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.197024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.197024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.197024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.197024] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 59dedfe4-c20a-4e77-9a2d-c629ce5a90a5 is going to be updated. [ 914.202708] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.203129] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.237703] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.237703] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.237703] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.237703] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.237703] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.237703] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-59dedfe4-c20a-4e77-9a2d-c629ce5a90a5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.304912] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.304912] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.304912] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.304912] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.304912] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.304912] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 is going to be updated. [ 914.371022] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.371022] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.371022] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.371022] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.371022] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.381487] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 in Status: IN_PROGRESS for 2s [ 914.487561] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2: rpc.has_security_group_logging(os_id): False [ 914.506164] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.506445] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.506445] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.506858] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.506858] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.506984] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.507143] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.507224] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.507409] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.511113] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.511382] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.511495] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.511562] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.511718] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.511796] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.511990] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.512138] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.512209] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.512384] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.512462] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.512549] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 is going to be updated. [ 914.526148] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 in Status: SUCCESS [ 914.526378] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 deletion is rescheduled due to dependency. [ 914.527064] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.527064] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.527064] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.527235] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.527368] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.527454] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.528025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.528025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.528025] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ddb3b9a8-c63d-4123-aa7f-cbf2b5279231',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.571894] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 in Status: SUCCESS [ 914.572201] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.587111] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.587111] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.587111] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.587111] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.587111] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.606447] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 in Status: IN_PROGRESS for 2s [ 914.864548] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d in Status: SUCCESS [ 914.864772] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.864951] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.865216] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.865417] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.865542] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.865608] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.865765] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.865846] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.865942] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.869226] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f33bcef8-0b06-4301-b08b-ba4a7cd9e47a in Status: SUCCESS [ 914.869692] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.869692] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.869803] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.869973] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.870096] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.870337] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.870439] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.870524] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.870621] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f33bcef8-0b06-4301-b08b-ba4a7cd9e47a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.031471] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ddb3b9a8-c63d-4123-aa7f-cbf2b5279231',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.378013] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.378013] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f33bcef8-0b06-4301-b08b-ba4a7cd9e47a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.538258] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ddb3b9a8-c63d-4123-aa7f-cbf2b5279231',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.633723] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b94d044-5ce0-4270-aced-c26d396494bc in Status: SUCCESS [ 915.633952] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b94d044-5ce0-4270-aced-c26d396494bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.634136] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b94d044-5ce0-4270-aced-c26d396494bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.634358] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b94d044-5ce0-4270-aced-c26d396494bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.634547] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.634662] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.634723] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.634868] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.634944] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.635036] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b94d044-5ce0-4270-aced-c26d396494bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.635124] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2b94d044-5ce0-4270-aced-c26d396494bc',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.875528] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.876831] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f33bcef8-0b06-4301-b08b-ba4a7cd9e47a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.042437] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.042437] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.042437] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.042735] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.042858] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.042986] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 is going to be updated. [ 916.047186] env[66502]: INFO networking_nsxv3.common.synchronization [None req-aaa4b4b5-faad-4ae2-af61-6001508d63e3 None None] Enqueued Resource ID: 54e9def8-c139-4a72-9639-3242ad7aa363 with Priority: HIGHEST for action port [ 916.047508] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54e9def8-c139-4a72-9639-3242ad7aa363 with Priority: HIGHEST for action port [ 916.048524] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-54e9def8-c139-4a72-9639-3242ad7aa363 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.048753] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54e9def8-c139-4a72-9639-3242ad7aa363" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.048893] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54e9def8-c139-4a72-9639-3242ad7aa363" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.049332] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54e9def8-c139-4a72-9639-3242ad7aa363" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.049463] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54e9def8-c139-4a72-9639-3242ad7aa363',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.089633] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.089873] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.090016] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.090360] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.090610] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.102264] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 in Status: IN_PROGRESS for 2s [ 916.141845] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b94d044-5ce0-4270-aced-c26d396494bc taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.141845] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b94d044-5ce0-4270-aced-c26d396494bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.141845] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b94d044-5ce0-4270-aced-c26d396494bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.141845] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b94d044-5ce0-4270-aced-c26d396494bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.141845] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.141845] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.141845] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.142203] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.142203] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.142203] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b94d044-5ce0-4270-aced-c26d396494bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.142320] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b94d044-5ce0-4270-aced-c26d396494bc taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.142520] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b94d044-5ce0-4270-aced-c26d396494bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.142520] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b94d044-5ce0-4270-aced-c26d396494bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.142831] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b94d044-5ce0-4270-aced-c26d396494bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.142831] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.143917] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.143917] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.143917] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.143917] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.143917] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b94d044-5ce0-4270-aced-c26d396494bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.143917] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2b94d044-5ce0-4270-aced-c26d396494bc',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.378621] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.378854] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.378854] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.379034] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.379089] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.379212] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d is going to be updated. [ 916.382819] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.383058] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.383058] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.383316] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.383406] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.383506] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f33bcef8-0b06-4301-b08b-ba4a7cd9e47a is going to be updated. [ 916.411391] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 in Status: SUCCESS [ 916.411770] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.411952] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.412254] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.412497] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.412605] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.413217] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.413217] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.413217] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.413217] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0bae9bdb-dcb4-4110-bcb0-1b0548a94738',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 916.494047] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.494375] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.494499] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.494906] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.495105] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.497341] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.497503] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.497582] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.498014] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.498014] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.519239] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d in Status: IN_PROGRESS for 2s [ 916.520146] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f33bcef8-0b06-4301-b08b-ba4a7cd9e47a in Status: IN_PROGRESS for 2s [ 916.552298] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 54e9def8-c139-4a72-9639-3242ad7aa363 [ 916.552744] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.552744] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.552910] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.553552] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.553552] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.553552] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:54e9def8-c139-4a72-9639-3242ad7aa363 already deleted. [ 916.553552] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54e9def8-c139-4a72-9639-3242ad7aa363" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.644175] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 in Status: SUCCESS [ 916.644175] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.649087] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2b94d044-5ce0-4270-aced-c26d396494bc: rpc.has_security_group_logging(os_id): False [ 916.676061] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.676298] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.676366] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.676618] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.676716] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.676959] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.677585] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.677857] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.678179] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.678318] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.679473] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.679473] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.679473] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.679473] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.679473] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.680104] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.680104] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.680104] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.680264] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.680264] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.680329] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b94d044-5ce0-4270-aced-c26d396494bc is going to be created. [ 916.900064] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.900064] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.900064] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.900064] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.900064] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.917958] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.917958] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.917958] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.917958] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.917958] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.917958] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.917958] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.918811] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.918811] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.918811] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 916.918811] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 is going to be updated. [ 916.933929] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b94d044-5ce0-4270-aced-c26d396494bc in Status: IN_PROGRESS for 2s [ 916.987066] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 916.987066] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 916.987066] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 916.987066] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 916.987066] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.027352] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 in Status: IN_PROGRESS for 2s [ 918.113256] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 in Status: SUCCESS [ 918.113766] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.113766] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.113905] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.114357] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.114510] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.114572] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.114743] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.115427] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.115571] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.115698] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ddb3b9a8-c63d-4123-aa7f-cbf2b5279231',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.539816] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d in Status: SUCCESS [ 918.540482] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.540482] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.540790] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.541705] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.541705] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.541705] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.541705] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.542103] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.542150] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.542288] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.546867] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f33bcef8-0b06-4301-b08b-ba4a7cd9e47a in Status: SUCCESS [ 918.546867] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.546867] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.546867] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.547155] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.547155] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.547155] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.547390] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.547507] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.547611] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.548425] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f33bcef8-0b06-4301-b08b-ba4a7cd9e47a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.618568] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.618746] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.618823] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.619095] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.619344] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.619409] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.619591] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.619711] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.619743] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.621106] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.621106] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.621106] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.621106] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.621106] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.621106] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.621106] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.621106] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.621106] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.621106] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.621106] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.621106] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ddb3b9a8-c63d-4123-aa7f-cbf2b5279231',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.953264] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2b94d044-5ce0-4270-aced-c26d396494bc in Status: SUCCESS [ 918.953652] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b94d044-5ce0-4270-aced-c26d396494bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.042472] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 in Status: SUCCESS [ 919.042622] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0bae9bdb-dcb4-4110-bcb0-1b0548a94738 deletion is rescheduled due to dependency. [ 919.042741] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0bae9bdb-dcb4-4110-bcb0-1b0548a94738" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.050545] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.050716] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.050781] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.051166] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.051210] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.051290] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.051373] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.051502] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.051591] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.051679] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.051828] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.051929] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.051992] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.052148] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.052291] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.052387] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.052448] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.052585] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.052678] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.052737] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.052829] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.054080] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f33bcef8-0b06-4301-b08b-ba4a7cd9e47a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.124379] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ddb3b9a8-c63d-4123-aa7f-cbf2b5279231: rpc.has_security_group_logging(os_id): False [ 919.150711] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.150869] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.151011] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.151164] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.151257] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.151460] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.151562] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.151625] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.151778] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.152043] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.152089] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.152159] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.152221] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.152558] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.152689] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.153194] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.153194] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.153194] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.153388] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.153758] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.153758] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 is going to be updated. [ 919.282289] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.282289] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.282643] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.286333] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.286841] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.318513] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 in Status: IN_PROGRESS for 2s [ 919.457067] env[66502]: INFO networking_nsxv3.common.synchronization [None req-788c0b4e-8fa8-49fa-b92c-5c032c91b882 None None] Enqueued Resource ID: fa755079-5750-4af2-8d04-effe8573bcd0 with Priority: HIGHEST for action port [ 919.457926] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa755079-5750-4af2-8d04-effe8573bcd0 with Priority: HIGHEST for action port [ 919.459219] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa755079-5750-4af2-8d04-effe8573bcd0 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.459564] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa755079-5750-4af2-8d04-effe8573bcd0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.459693] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa755079-5750-4af2-8d04-effe8573bcd0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.460574] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa755079-5750-4af2-8d04-effe8573bcd0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.460574] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa755079-5750-4af2-8d04-effe8573bcd0',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.555924] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e5c2909-7671-4f4c-995e-cc0f19e2e48d: rpc.has_security_group_logging(os_id): False [ 919.558748] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f33bcef8-0b06-4301-b08b-ba4a7cd9e47a: rpc.has_security_group_logging(os_id): False [ 919.605365] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.609026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.609026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.609026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.609026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.609026] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.609026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.609026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.609026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.609026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.609026] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.609026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.609026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.609026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.609026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.609642] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.609642] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.609642] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.609642] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.609642] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.609642] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d is going to be updated. [ 919.610556] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.610698] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.611110] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.611110] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.611461] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.611739] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.611936] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.612888] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.612888] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.612888] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.612888] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f33bcef8-0b06-4301-b08b-ba4a7cd9e47a is going to be created. [ 919.702900] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.702900] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.702900] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.703164] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.703386] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.709540] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.709704] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.709773] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.710060] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.710251] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.724590] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f33bcef8-0b06-4301-b08b-ba4a7cd9e47a in Status: IN_PROGRESS for 2s [ 919.728359] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d in Status: IN_PROGRESS for 2s [ 919.964105] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fa755079-5750-4af2-8d04-effe8573bcd0 [ 919.964105] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.964105] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.964105] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.964105] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.964105] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.964105] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fa755079-5750-4af2-8d04-effe8573bcd0 already deleted. [ 919.964105] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa755079-5750-4af2-8d04-effe8573bcd0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.660268] env[66502]: INFO networking_nsxv3.common.synchronization [req-1d545f03-f093-4733-9b15-d88dbef15d3b req-8285357c-1654-4a57-86b4-9ae2586c5b15 tempest-SecurityGroupsTestJSON-779026578 tempest-SecurityGroupsTestJSON-779026578-project-member] Enqueued Resource ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d with Priority: HIGHEST for action security_group_members [ 920.666466] env[66502]: INFO networking_nsxv3.common.synchronization [req-1d545f03-f093-4733-9b15-d88dbef15d3b req-8285357c-1654-4a57-86b4-9ae2586c5b15 tempest-SecurityGroupsTestJSON-779026578 tempest-SecurityGroupsTestJSON-779026578-project-member] Enqueued Resource ID: e42397ad-0a68-4ab5-8c3b-6f651d1f21e6 with Priority: HIGHEST for action security_group_members [ 920.666802] env[66502]: INFO networking_nsxv3.common.synchronization [req-1d545f03-f093-4733-9b15-d88dbef15d3b req-8285357c-1654-4a57-86b4-9ae2586c5b15 tempest-SecurityGroupsTestJSON-779026578 tempest-SecurityGroupsTestJSON-779026578-project-member] Enqueued Resource ID: f33bcef8-0b06-4301-b08b-ba4a7cd9e47a with Priority: HIGHEST for action security_group_members [ 920.667802] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d with Priority: HIGHEST for action security_group_members [ 920.670319] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42397ad-0a68-4ab5-8c3b-6f651d1f21e6 with Priority: HIGHEST for action security_group_members [ 920.670319] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f33bcef8-0b06-4301-b08b-ba4a7cd9e47a with Priority: HIGHEST for action security_group_members [ 920.670319] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.670319] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.670319] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.670319] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.670319] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.670319] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.670319] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.670319] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.670803] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.670803] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.672055] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42397ad-0a68-4ab5-8c3b-6f651d1f21e6 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.672219] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42397ad-0a68-4ab5-8c3b-6f651d1f21e6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.672343] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42397ad-0a68-4ab5-8c3b-6f651d1f21e6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.672848] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42397ad-0a68-4ab5-8c3b-6f651d1f21e6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.673121] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.673325] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.673448] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.673722] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.673874] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.674935] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e42397ad-0a68-4ab5-8c3b-6f651d1f21e6',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.678553] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.678553] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.678553] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.678553] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.678553] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.678553] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.678553] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.678553] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.678553] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.678553] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f33bcef8-0b06-4301-b08b-ba4a7cd9e47a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.723865] env[66502]: INFO networking_nsxv3.common.synchronization [req-1d545f03-f093-4733-9b15-d88dbef15d3b req-8285357c-1654-4a57-86b4-9ae2586c5b15 tempest-SecurityGroupsTestJSON-779026578 tempest-SecurityGroupsTestJSON-779026578-project-member] Enqueued Resource ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d with Priority: HIGHEST for action security_group_rules [ 920.724024] env[66502]: INFO networking_nsxv3.common.synchronization [req-1d545f03-f093-4733-9b15-d88dbef15d3b req-8285357c-1654-4a57-86b4-9ae2586c5b15 tempest-SecurityGroupsTestJSON-779026578 tempest-SecurityGroupsTestJSON-779026578-project-member] Enqueued Resource ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d with Priority: HIGHEST for action security_group_members [ 920.724171] env[66502]: INFO networking_nsxv3.common.synchronization [req-1d545f03-f093-4733-9b15-d88dbef15d3b req-8285357c-1654-4a57-86b4-9ae2586c5b15 tempest-SecurityGroupsTestJSON-779026578 tempest-SecurityGroupsTestJSON-779026578-project-member] Enqueued Resource ID: e42397ad-0a68-4ab5-8c3b-6f651d1f21e6 with Priority: HIGHEST for action security_group_rules [ 920.724342] env[66502]: INFO networking_nsxv3.common.synchronization [req-1d545f03-f093-4733-9b15-d88dbef15d3b req-8285357c-1654-4a57-86b4-9ae2586c5b15 tempest-SecurityGroupsTestJSON-779026578 tempest-SecurityGroupsTestJSON-779026578-project-member] Enqueued Resource ID: e42397ad-0a68-4ab5-8c3b-6f651d1f21e6 with Priority: HIGHEST for action security_group_members [ 920.724495] env[66502]: INFO networking_nsxv3.common.synchronization [req-1d545f03-f093-4733-9b15-d88dbef15d3b req-8285357c-1654-4a57-86b4-9ae2586c5b15 tempest-SecurityGroupsTestJSON-779026578 tempest-SecurityGroupsTestJSON-779026578-project-member] Enqueued Resource ID: f33bcef8-0b06-4301-b08b-ba4a7cd9e47a with Priority: HIGHEST for action security_group_rules [ 920.724650] env[66502]: INFO networking_nsxv3.common.synchronization [req-1d545f03-f093-4733-9b15-d88dbef15d3b req-8285357c-1654-4a57-86b4-9ae2586c5b15 tempest-SecurityGroupsTestJSON-779026578 tempest-SecurityGroupsTestJSON-779026578-project-member] Enqueued Resource ID: f33bcef8-0b06-4301-b08b-ba4a7cd9e47a with Priority: HIGHEST for action security_group_members [ 920.724771] env[66502]: INFO networking_nsxv3.common.synchronization [req-1d545f03-f093-4733-9b15-d88dbef15d3b req-8285357c-1654-4a57-86b4-9ae2586c5b15 tempest-SecurityGroupsTestJSON-779026578 tempest-SecurityGroupsTestJSON-779026578-project-member] Enqueued Resource ID: 3dfbda6c-14b7-4eff-a6d2-a50b2908e6f3 with Priority: HIGHEST for action port [ 920.726244] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d with Priority: HIGHEST for action security_group_rules [ 920.726351] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42397ad-0a68-4ab5-8c3b-6f651d1f21e6 with Priority: HIGHEST for action security_group_rules [ 920.726455] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f33bcef8-0b06-4301-b08b-ba4a7cd9e47a with Priority: HIGHEST for action security_group_members [ 920.726552] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3dfbda6c-14b7-4eff-a6d2-a50b2908e6f3 with Priority: HIGHEST for action port [ 920.726711] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f33bcef8-0b06-4301-b08b-ba4a7cd9e47a with Priority: HIGHEST for action security_group_rules [ 920.726865] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d with Priority: HIGHEST for action security_group_members [ 920.726960] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42397ad-0a68-4ab5-8c3b-6f651d1f21e6 with Priority: HIGHEST for action security_group_members [ 920.727709] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e5c2909-7671-4f4c-995e-cc0f19e2e48d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.727820] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.728130] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e42397ad-0a68-4ab5-8c3b-6f651d1f21e6 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.728243] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e42397ad-0a68-4ab5-8c3b-6f651d1f21e6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.728366] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e42397ad-0a68-4ab5-8c3b-6f651d1f21e6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.728674] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e42397ad-0a68-4ab5-8c3b-6f651d1f21e6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.728769] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e42397ad-0a68-4ab5-8c3b-6f651d1f21e6',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.730021] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.730021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.730758] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-3dfbda6c-14b7-4eff-a6d2-a50b2908e6f3 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.730879] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3dfbda6c-14b7-4eff-a6d2-a50b2908e6f3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.730948] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3dfbda6c-14b7-4eff-a6d2-a50b2908e6f3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.731168] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3dfbda6c-14b7-4eff-a6d2-a50b2908e6f3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.731249] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3dfbda6c-14b7-4eff-a6d2-a50b2908e6f3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.732641] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.732641] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.732780] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.732780] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.732928] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42397ad-0a68-4ab5-8c3b-6f651d1f21e6 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.735025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42397ad-0a68-4ab5-8c3b-6f651d1f21e6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.180189] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.181378] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e42397ad-0a68-4ab5-8c3b-6f651d1f21e6',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.182235] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f33bcef8-0b06-4301-b08b-ba4a7cd9e47a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.237608] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3dfbda6c-14b7-4eff-a6d2-a50b2908e6f3 with status ACTIVE [ 921.237848] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.237984] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.238076] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.238348] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.238472] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.238700] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.238847] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.238922] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.239209] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.239846] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.240116] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.240240] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.240310] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.240467] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.240548] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.240632] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3dfbda6c-14b7-4eff-a6d2-a50b2908e6f3 is going to be updated. [ 921.241948] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42397ad-0a68-4ab5-8c3b-6f651d1f21e6 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.242075] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42397ad-0a68-4ab5-8c3b-6f651d1f21e6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.268111] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.268324] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.268409] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.268727] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.268815] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.269012] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3dfbda6c-14b7-4eff-a6d2-a50b2908e6f3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.356866] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 in Status: SUCCESS [ 921.358048] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.685548] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.686619] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e42397ad-0a68-4ab5-8c3b-6f651d1f21e6',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.688890] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f33bcef8-0b06-4301-b08b-ba4a7cd9e47a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.743068] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f33bcef8-0b06-4301-b08b-ba4a7cd9e47a in Status: SUCCESS [ 921.743068] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.743068] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.743068] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.743068] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f33bcef8-0b06-4301-b08b-ba4a7cd9e47a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.749404] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d in Status: SUCCESS [ 921.749594] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.750188] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.750459] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.750662] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.190392] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.191913] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.191913] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.191913] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.191913] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.191913] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e42397ad-0a68-4ab5-8c3b-6f651d1f21e6 is going to be created. [ 922.193125] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.193125] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.193125] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.195133] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.195133] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.195133] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d is going to be updated. [ 922.195895] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.196040] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.196107] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.198041] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.198041] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.198041] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f33bcef8-0b06-4301-b08b-ba4a7cd9e47a is going to be updated. [ 922.238909] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.239131] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.239241] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.239420] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.239894] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.248173] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.248550] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.248766] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.249258] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.249258] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.251396] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.251396] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.252475] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.252601] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.252685] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.252886] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.253183] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.255349] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.255504] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.256415] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42397ad-0a68-4ab5-8c3b-6f651d1f21e6 in Status: UNINITIALIZED for 2s [ 922.267336] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d in Status: IN_PROGRESS for 2s [ 922.268431] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f33bcef8-0b06-4301-b08b-ba4a7cd9e47a in Status: IN_PROGRESS for 2s [ 924.270632] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42397ad-0a68-4ab5-8c3b-6f651d1f21e6 in Status: SUCCESS [ 924.273949] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42397ad-0a68-4ab5-8c3b-6f651d1f21e6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.273949] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42397ad-0a68-4ab5-8c3b-6f651d1f21e6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.273949] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42397ad-0a68-4ab5-8c3b-6f651d1f21e6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.274308] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.274386] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.274432] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.274632] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.274753] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.274860] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e42397ad-0a68-4ab5-8c3b-6f651d1f21e6',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.300821] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d in Status: SUCCESS [ 924.301211] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.301881] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.302157] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.302356] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.302510] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.302606] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.302790] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.302872] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.302970] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.307162] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f33bcef8-0b06-4301-b08b-ba4a7cd9e47a in Status: SUCCESS [ 924.307162] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.307162] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.307162] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.307162] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.307162] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.307162] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.308442] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.308593] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.308734] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f33bcef8-0b06-4301-b08b-ba4a7cd9e47a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.373629] env[66502]: INFO networking_nsxv3.common.synchronization [req-0ab58060-9f7f-49fa-8047-0654ca944018 req-0c4ae1b8-b3b0-4593-8a9c-253228ca68a0 tempest-SecurityGroupsTestJSON-779026578 tempest-SecurityGroupsTestJSON-779026578-project-member] Enqueued Resource ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d with Priority: HIGHEST for action security_group_members [ 924.373629] env[66502]: INFO networking_nsxv3.common.synchronization [req-0ab58060-9f7f-49fa-8047-0654ca944018 req-0c4ae1b8-b3b0-4593-8a9c-253228ca68a0 tempest-SecurityGroupsTestJSON-779026578 tempest-SecurityGroupsTestJSON-779026578-project-member] Enqueued Resource ID: e42397ad-0a68-4ab5-8c3b-6f651d1f21e6 with Priority: HIGHEST for action security_group_members [ 924.373629] env[66502]: INFO networking_nsxv3.common.synchronization [req-0ab58060-9f7f-49fa-8047-0654ca944018 req-0c4ae1b8-b3b0-4593-8a9c-253228ca68a0 tempest-SecurityGroupsTestJSON-779026578 tempest-SecurityGroupsTestJSON-779026578-project-member] Enqueued Resource ID: f33bcef8-0b06-4301-b08b-ba4a7cd9e47a with Priority: HIGHEST for action security_group_members [ 924.374159] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d with Priority: HIGHEST for action security_group_members [ 924.374648] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e42397ad-0a68-4ab5-8c3b-6f651d1f21e6 with Priority: HIGHEST for action security_group_members [ 924.374912] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f33bcef8-0b06-4301-b08b-ba4a7cd9e47a with Priority: HIGHEST for action security_group_members [ 924.375455] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.375736] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.376147] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-e42397ad-0a68-4ab5-8c3b-6f651d1f21e6 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.376613] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-e42397ad-0a68-4ab5-8c3b-6f651d1f21e6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.377035] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.378135] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.779085] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('e42397ad-0a68-4ab5-8c3b-6f651d1f21e6',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.812966] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.812966] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f33bcef8-0b06-4301-b08b-ba4a7cd9e47a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.282615] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('e42397ad-0a68-4ab5-8c3b-6f651d1f21e6',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.313741] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.315852] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f33bcef8-0b06-4301-b08b-ba4a7cd9e47a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.785157] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.785279] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.785342] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.785704] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.785867] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.786098] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e42397ad-0a68-4ab5-8c3b-6f651d1f21e6 is going to be updated. [ 925.816836] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.817016] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.817117] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.817387] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.817614] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.817672] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d is going to be updated. [ 925.819653] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.819897] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.819897] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.820580] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.820804] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.821940] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.822069] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.822146] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.822314] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.822400] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.822490] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f33bcef8-0b06-4301-b08b-ba4a7cd9e47a is going to be updated. [ 925.837588] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42397ad-0a68-4ab5-8c3b-6f651d1f21e6 in Status: IN_PROGRESS for 2s [ 925.865763] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.865962] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.865962] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.866270] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.866430] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.868546] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.868705] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.868771] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.868964] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.869141] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.880551] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f33bcef8-0b06-4301-b08b-ba4a7cd9e47a in Status: IN_PROGRESS for 2s [ 925.881271] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d in Status: IN_PROGRESS for 2s [ 927.849759] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: e42397ad-0a68-4ab5-8c3b-6f651d1f21e6 in Status: SUCCESS [ 927.849759] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42397ad-0a68-4ab5-8c3b-6f651d1f21e6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.849759] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42397ad-0a68-4ab5-8c3b-6f651d1f21e6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.851823] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42397ad-0a68-4ab5-8c3b-6f651d1f21e6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.851823] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.851823] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.851823] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.851823] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.851823] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.851823] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42397ad-0a68-4ab5-8c3b-6f651d1f21e6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.851823] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('e42397ad-0a68-4ab5-8c3b-6f651d1f21e6',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.851823] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-e42397ad-0a68-4ab5-8c3b-6f651d1f21e6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.852737] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-e42397ad-0a68-4ab5-8c3b-6f651d1f21e6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.852737] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.852737] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.852737] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.852737] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.852929] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.852929] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('e42397ad-0a68-4ab5-8c3b-6f651d1f21e6',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.892905] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f33bcef8-0b06-4301-b08b-ba4a7cd9e47a in Status: SUCCESS [ 927.893847] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.893847] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.893847] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.893847] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.894081] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.894081] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.894461] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.894553] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.894637] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.894726] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f33bcef8-0b06-4301-b08b-ba4a7cd9e47a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.896628] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d in Status: SUCCESS [ 927.896792] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.896961] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.897164] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.897810] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.897810] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.897810] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.897810] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.897810] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.897810] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f33bcef8-0b06-4301-b08b-ba4a7cd9e47a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.898637] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.898978] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.898978] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.899206] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.899275] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.899457] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.899542] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.899629] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.899722] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.900903] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.901107] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.901280] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.902135] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.902135] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.902135] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.902135] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.902135] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.355315] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('e42397ad-0a68-4ab5-8c3b-6f651d1f21e6',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.356558] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.356694] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.356767] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.356980] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.357081] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.357281] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.357386] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.357466] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.357591] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.357664] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.357748] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: e42397ad-0a68-4ab5-8c3b-6f651d1f21e6 is going to be deleted. [ 928.396247] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.396485] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.396556] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.396741] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.397415] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.397415] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-e42397ad-0a68-4ab5-8c3b-6f651d1f21e6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.402244] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.402244] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.402244] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.402244] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.402244] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.402505] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.402505] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.402505] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.402689] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.402751] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.402839] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f33bcef8-0b06-4301-b08b-ba4a7cd9e47a is going to be updated. [ 928.403921] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f33bcef8-0b06-4301-b08b-ba4a7cd9e47a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.405262] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.405398] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.405536] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.434500] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.434685] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.434810] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.434920] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.435062] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.445448] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f33bcef8-0b06-4301-b08b-ba4a7cd9e47a in Status: IN_PROGRESS for 2s [ 928.770998] env[66502]: INFO networking_nsxv3.common.synchronization [req-1d226667-0ab3-4e74-a82e-fbca9f82de27 req-995db8b2-fb24-44a8-bc3a-af938eeb4295 tempest-ImagesTestJSON-1088460097 tempest-ImagesTestJSON-1088460097-project-member] Enqueued Resource ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 with Priority: HIGHEST for action security_group_members [ 928.770998] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 with Priority: HIGHEST for action security_group_members [ 928.772443] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.773415] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.775045] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.775045] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.775045] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.775045] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.775045] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.775045] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.775045] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.775045] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.859513] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for e42397ad-0a68-4ab5-8c3b-6f651d1f21e6: rpc.has_security_group_logging(os_id): False [ 928.880041] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.880041] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.880041] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.880041] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.880041] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.880041] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.880041] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.880041] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.880041] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.880041] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.880041] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e42397ad-0a68-4ab5-8c3b-6f651d1f21e6 is going to be created. [ 928.901767] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/e42397ad-0a68-4ab5-8c3b-6f651d1f21e6], does not exist path=[/infra/domains/default/groups/e42397ad-0a68-4ab5-8c3b-6f651d1f21e6]."\n}' [ 928.901767] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e42397ad-0a68-4ab5-8c3b-6f651d1f21e6 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e42397ad-0a68-4ab5-8c3b-6f651d1f21e6 [ 928.901767] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 928.908345] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f33bcef8-0b06-4301-b08b-ba4a7cd9e47a: rpc.has_security_group_logging(os_id): False [ 928.909044] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.932702] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.932972] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.932972] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.933276] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.933389] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.934630] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.934775] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.934935] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.935077] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.935187] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.935317] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f33bcef8-0b06-4301-b08b-ba4a7cd9e47a is going to be updated. [ 928.955462] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.955462] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.955462] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.955462] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.956420] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.957774] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.958157] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.958370] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.958716] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.960179] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.960179] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.960179] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.960179] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.960179] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.960179] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.960179] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e42397ad-0a68-4ab5-8c3b-6f651d1f21e6 is going to be created. [ 928.983592] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/e42397ad-0a68-4ab5-8c3b-6f651d1f21e6], does not exist path=[/infra/domains/default/groups/e42397ad-0a68-4ab5-8c3b-6f651d1f21e6]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e42397ad-0a68-4ab5-8c3b-6f651d1f21e6 [ 928.984457] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e42397ad-0a68-4ab5-8c3b-6f651d1f21e6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.984985] env[66502]: Traceback (most recent call last): [ 928.985291] env[66502]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 928.985291] env[66502]: return func(*args, **kwargs) [ 928.985291] env[66502]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 928.985291] env[66502]: res.raise_for_status() [ 928.985291] env[66502]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 928.985291] env[66502]: raise HTTPError(http_error_msg, response=self) [ 928.985291] env[66502]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e42397ad-0a68-4ab5-8c3b-6f651d1f21e6 [ 928.985291] env[66502]: During handling of the above exception, another exception occurred: [ 928.985291] env[66502]: Traceback (most recent call last): [ 928.985291] env[66502]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 928.985291] env[66502]: listener.cb(fileno) [ 928.985291] env[66502]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 928.985291] env[66502]: result = function(*args, **kwargs) [ 928.985291] env[66502]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 928.985291] env[66502]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 928.985291] env[66502]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 928.985291] env[66502]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 928.985291] env[66502]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 928.985291] env[66502]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 928.985291] env[66502]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 928.985291] env[66502]: res.raise_for_status() [ 928.985291] env[66502]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 928.985291] env[66502]: raise HTTPError(http_error_msg, response=self) [ 928.985291] env[66502]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/e42397ad-0a68-4ab5-8c3b-6f651d1f21e6 [ 928.985291] env[66502]: Removing descriptor: 20 [ 929.006889] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.006889] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.006889] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.006889] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.006889] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.023035] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f33bcef8-0b06-4301-b08b-ba4a7cd9e47a in Status: IN_PROGRESS for 2s [ 929.023035] env[66502]: INFO networking_nsxv3.common.synchronization [req-862e42a6-ee52-4b46-9dd9-984e422f71f6 req-37ae52e4-b3a0-4313-87e8-9f17b0752c9b tempest-ServerGroupTestJSON-1641290138 tempest-ServerGroupTestJSON-1641290138-project-member] Enqueued Resource ID: 2b94d044-5ce0-4270-aced-c26d396494bc with Priority: HIGHEST for action security_group_members [ 929.024214] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b94d044-5ce0-4270-aced-c26d396494bc with Priority: HIGHEST for action security_group_members [ 929.027585] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-2b94d044-5ce0-4270-aced-c26d396494bc taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.027585] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2b94d044-5ce0-4270-aced-c26d396494bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.027585] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2b94d044-5ce0-4270-aced-c26d396494bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.027585] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2b94d044-5ce0-4270-aced-c26d396494bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.027585] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.027585] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.027585] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.027585] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.027585] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.027585] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2b94d044-5ce0-4270-aced-c26d396494bc',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.048303] env[66502]: INFO networking_nsxv3.common.synchronization [None req-7414f431-44e2-4b9e-abb9-3439fcb1de79 None None] Enqueued Resource ID: 2e5bb7a3-3d90-460c-98d0-f00c58069b9b with Priority: HIGHEST for action port [ 929.049742] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2e5bb7a3-3d90-460c-98d0-f00c58069b9b with Priority: HIGHEST for action port [ 929.053754] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-2e5bb7a3-3d90-460c-98d0-f00c58069b9b taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.053754] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2e5bb7a3-3d90-460c-98d0-f00c58069b9b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.053754] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2e5bb7a3-3d90-460c-98d0-f00c58069b9b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.053754] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2e5bb7a3-3d90-460c-98d0-f00c58069b9b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.053754] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2e5bb7a3-3d90-460c-98d0-f00c58069b9b',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.277366] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.392619] env[66502]: INFO networking_nsxv3.common.synchronization [req-4dd1f111-eee7-4881-bb13-1d93da89090d req-ebe7dd7d-66f4-46b8-bd9e-c422bb538b10 tempest-ImagesOneServerNegativeTestJSON-1621881971 tempest-ImagesOneServerNegativeTestJSON-1621881971-project-member] Enqueued Resource ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 with Priority: HIGHEST for action security_group_members [ 929.393058] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 with Priority: HIGHEST for action security_group_members [ 929.393515] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.393745] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.394081] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.394563] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.394759] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.394925] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.395051] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.395286] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.395394] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.395498] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ddb3b9a8-c63d-4123-aa7f-cbf2b5279231',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.412098] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.412098] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.412098] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.412098] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.412098] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.412292] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d is going to be updated. [ 929.450745] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.450939] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.451010] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.451270] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.451425] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.466696] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d in Status: IN_PROGRESS for 2s [ 929.530581] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.530856] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.530856] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.531273] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.554187] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2e5bb7a3-3d90-460c-98d0-f00c58069b9b [ 929.554797] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.554797] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.554797] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.555205] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.555272] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.555342] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2e5bb7a3-3d90-460c-98d0-f00c58069b9b already deleted. [ 929.555402] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2e5bb7a3-3d90-460c-98d0-f00c58069b9b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.556933] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.557419] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.557643] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.557714] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.557976] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.558148] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.558264] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b94d044-5ce0-4270-aced-c26d396494bc is going to be updated. [ 929.623248] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.623452] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.623518] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.623700] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.623975] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.638298] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b94d044-5ce0-4270-aced-c26d396494bc in Status: IN_PROGRESS for 2s [ 929.780294] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.898866] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.899216] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.899216] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.900575] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.935862] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.936742] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.936742] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.936742] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.937068] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.937068] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.937180] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 is going to be updated. [ 929.974601] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.975017] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.975101] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.975324] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.975526] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.987464] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 in Status: IN_PROGRESS for 2s [ 930.285561] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.285744] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.285813] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.286434] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.286587] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.286709] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 is going to be updated. [ 930.355853] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.355983] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.356131] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.356318] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.356540] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.369167] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 in Status: IN_PROGRESS for 2s [ 930.461139] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f33bcef8-0b06-4301-b08b-ba4a7cd9e47a in Status: SUCCESS [ 930.461139] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f33bcef8-0b06-4301-b08b-ba4a7cd9e47a deletion is rescheduled due to dependency. [ 930.461139] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.038036] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f33bcef8-0b06-4301-b08b-ba4a7cd9e47a in Status: SUCCESS [ 931.038514] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f33bcef8-0b06-4301-b08b-ba4a7cd9e47a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.479288] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d in Status: SUCCESS [ 931.479543] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.479697] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.479931] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.480137] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.481406] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.481406] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.481406] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.481406] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.481406] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.481406] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.481406] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.481406] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.481406] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.481406] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.481406] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.481406] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.482284] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.482284] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.482284] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.482284] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.650688] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2b94d044-5ce0-4270-aced-c26d396494bc in Status: SUCCESS [ 931.650991] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2b94d044-5ce0-4270-aced-c26d396494bc deletion is rescheduled due to dependency. [ 931.651159] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2b94d044-5ce0-4270-aced-c26d396494bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.915697] env[66502]: INFO networking_nsxv3.common.synchronization [None req-7ef99fc0-1533-41e7-8226-1725194e0184 None None] Enqueued Resource ID: 163acb5d-717e-401e-b4d8-0b02ce4509d6 with Priority: HIGHEST for action port [ 931.916318] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 163acb5d-717e-401e-b4d8-0b02ce4509d6 with Priority: HIGHEST for action port [ 931.916676] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-163acb5d-717e-401e-b4d8-0b02ce4509d6 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.916823] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-163acb5d-717e-401e-b4d8-0b02ce4509d6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.916880] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-163acb5d-717e-401e-b4d8-0b02ce4509d6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.917656] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-163acb5d-717e-401e-b4d8-0b02ce4509d6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.917736] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('163acb5d-717e-401e-b4d8-0b02ce4509d6',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.984705] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9e5c2909-7671-4f4c-995e-cc0f19e2e48d: rpc.has_security_group_logging(os_id): False [ 932.002139] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 in Status: SUCCESS [ 932.002139] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 deletion is rescheduled due to dependency. [ 932.002139] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.008261] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.008444] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.008506] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.008780] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.030958] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.031322] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.031499] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.031593] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.031761] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.031889] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.032180] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.032341] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.032341] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.032516] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.032620] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.032818] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.032964] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.033675] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.033925] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.034054] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.034294] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d is going to be updated. [ 932.131022] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.131022] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.131022] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.131022] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.131022] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.178502] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d in Status: IN_PROGRESS for 2s [ 932.380986] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 in Status: SUCCESS [ 932.381689] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.420246] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 163acb5d-717e-401e-b4d8-0b02ce4509d6 [ 932.420613] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.422384] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.422384] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.422384] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.422384] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.422384] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:163acb5d-717e-401e-b4d8-0b02ce4509d6 already deleted. [ 932.422384] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-163acb5d-717e-401e-b4d8-0b02ce4509d6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.519097] env[66502]: INFO networking_nsxv3.common.synchronization [req-c253205e-7ac2-4f2e-8ed9-3e4dd1934ad5 req-835cc929-1207-4a1e-94a1-6da46a25d6b7 tempest-ServersTestJSON-1210226259 tempest-ServersTestJSON-1210226259-project-member] Enqueued Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_members [ 932.522308] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_members [ 932.523157] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.523303] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.523410] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.523577] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.523735] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.523834] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.523941] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.524053] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.524181] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.524275] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 932.955586] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-708 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.955872] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-708" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.956155] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-708" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.956303] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-708" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.956620] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.956799] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.956931] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.957541] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.957541] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.957739] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 932.957739] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 932.957853] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 932.958408] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 932.958408] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 932.958408] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 932.958408] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 932.983150] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 932.983780] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 932.984017] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 932.984306] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-708" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 932.986023] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-b8655f87-1d3e-41d8-a776-d9f582791cdf taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 932.986023] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-b8655f87-1d3e-41d8-a776-d9f582791cdf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 932.986023] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-b8655f87-1d3e-41d8-a776-d9f582791cdf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 932.986023] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-b8655f87-1d3e-41d8-a776-d9f582791cdf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 932.986023] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8655f87-1d3e-41d8-a776-d9f582791cdf',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.027680] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 933.489547] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.489963] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.489963] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.490302] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.490459] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.490618] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port b8655f87-1d3e-41d8-a776-d9f582791cdf not found, creating... [ 933.490891] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.491063] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.491181] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.491419] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.491626] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.492730] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.493079] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.493553] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.494493] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.494493] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.494493] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: b8655f87-1d3e-41d8-a776-d9f582791cdf is going to be created. [ 933.521541] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 933.521855] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 933.522075] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 933.522543] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 933.522659] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.522949] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-b8655f87-1d3e-41d8-a776-d9f582791cdf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.530877] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.035372] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.035372] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.035372] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.035372] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.035372] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.035372] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d226a97-2d69-4706-b98b-565700008c6f is going to be updated. [ 934.072449] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.072776] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.072776] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.073063] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.073318] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.085567] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: IN_PROGRESS for 2s [ 934.197161] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d in Status: SUCCESS [ 934.197434] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.290173] env[66502]: INFO networking_nsxv3.common.synchronization [req-c253205e-7ac2-4f2e-8ed9-3e4dd1934ad5 req-819cdb2b-014c-479c-87b0-bed1d699142d service nova] Enqueued Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_rules [ 934.290573] env[66502]: INFO networking_nsxv3.common.synchronization [req-c253205e-7ac2-4f2e-8ed9-3e4dd1934ad5 req-819cdb2b-014c-479c-87b0-bed1d699142d service nova] Enqueued Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_members [ 934.290818] env[66502]: INFO networking_nsxv3.common.synchronization [req-c253205e-7ac2-4f2e-8ed9-3e4dd1934ad5 req-819cdb2b-014c-479c-87b0-bed1d699142d service nova] Enqueued Resource ID: b8655f87-1d3e-41d8-a776-d9f582791cdf with Priority: HIGHEST for action port [ 934.291593] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_rules [ 934.291795] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_members [ 934.291944] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8655f87-1d3e-41d8-a776-d9f582791cdf with Priority: HIGHEST for action port [ 934.292354] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.292533] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.292635] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.292987] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.293078] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.294878] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.294983] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.296854] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8655f87-1d3e-41d8-a776-d9f582791cdf taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.296854] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8655f87-1d3e-41d8-a776-d9f582791cdf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.296854] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8655f87-1d3e-41d8-a776-d9f582791cdf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.296854] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8655f87-1d3e-41d8-a776-d9f582791cdf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.296854] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8655f87-1d3e-41d8-a776-d9f582791cdf',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.694831] env[66502]: INFO networking_nsxv3.common.synchronization [req-da83a8cb-a92a-403b-8942-a83f2b175eb5 req-5fded921-83b0-4f65-93cd-79b12183f78a tempest-ServersTestFqdnHostnames-1527225676 tempest-ServersTestFqdnHostnames-1527225676-project-member] Enqueued Resource ID: 6a050294-bf61-423f-b50c-cccbf8fa309f with Priority: HIGHEST for action security_group_members [ 934.695204] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a050294-bf61-423f-b50c-cccbf8fa309f with Priority: HIGHEST for action security_group_members [ 934.695360] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6a050294-bf61-423f-b50c-cccbf8fa309f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.695495] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6a050294-bf61-423f-b50c-cccbf8fa309f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.695572] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6a050294-bf61-423f-b50c-cccbf8fa309f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.695782] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6a050294-bf61-423f-b50c-cccbf8fa309f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.695956] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.696584] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.696736] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.696839] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.697029] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.697109] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6a050294-bf61-423f-b50c-cccbf8fa309f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.797625] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.797742] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.801170] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b8655f87-1d3e-41d8-a776-d9f582791cdf with status ACTIVE [ 934.801368] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.801572] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.801653] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.802849] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.802849] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.802849] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.802849] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.802849] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.802849] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.802849] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.803188] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.803188] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.803188] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.803307] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.803379] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.803464] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b8655f87-1d3e-41d8-a776-d9f582791cdf is going to be updated. [ 934.832806] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.832806] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.833067] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.833067] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.833219] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.833716] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8655f87-1d3e-41d8-a776-d9f582791cdf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.199559] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.199753] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.199825] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.200103] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.226283] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.226577] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.226577] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.226792] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.226856] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.229503] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.229503] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a050294-bf61-423f-b50c-cccbf8fa309f is going to be updated. [ 935.270066] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.270301] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.270416] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.270568] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.270712] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.286043] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a050294-bf61-423f-b50c-cccbf8fa309f in Status: IN_PROGRESS for 2s [ 936.097317] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: SUCCESS [ 936.097317] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.097317] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.097317] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.097317] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 936.097317] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 936.097317] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 936.097317] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 936.097317] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.097317] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.599125] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.101998] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.303839] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6a050294-bf61-423f-b50c-cccbf8fa309f in Status: SUCCESS [ 937.304324] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6a050294-bf61-423f-b50c-cccbf8fa309f deletion is rescheduled due to dependency. [ 937.304603] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6a050294-bf61-423f-b50c-cccbf8fa309f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.605762] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.605905] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.605905] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.606554] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.606737] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.606883] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d226a97-2d69-4706-b98b-565700008c6f is going to be updated. [ 937.644690] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.644866] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.644918] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.645167] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.645349] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.660513] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: IN_PROGRESS for 2s [ 939.265511] env[66502]: INFO networking_nsxv3.common.synchronization [req-e720ec9c-fcce-4629-bbc1-198fcbea6132 req-754828fc-8beb-42e2-b48d-3a090c2fefbd tempest-AttachInterfacesUnderV243Test-1353172127 tempest-AttachInterfacesUnderV243Test-1353172127-project-member] Enqueued Resource ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 with Priority: HIGHEST for action security_group_members [ 939.265511] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 with Priority: HIGHEST for action security_group_members [ 939.265911] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-2728c2e7-59ab-4cf2-bc7c-4c079064da76 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.268204] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.268428] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.268685] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.269488] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.269622] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.271067] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.271067] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.271067] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.271067] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2728c2e7-59ab-4cf2-bc7c-4c079064da76',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.294396] env[66502]: INFO networking_nsxv3.common.synchronization [req-e720ec9c-fcce-4629-bbc1-198fcbea6132 req-754828fc-8beb-42e2-b48d-3a090c2fefbd tempest-AttachInterfacesUnderV243Test-1353172127 tempest-AttachInterfacesUnderV243Test-1353172127-project-member] Enqueued Resource ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 with Priority: HIGHEST for action security_group_rules [ 939.294579] env[66502]: INFO networking_nsxv3.common.synchronization [req-e720ec9c-fcce-4629-bbc1-198fcbea6132 req-754828fc-8beb-42e2-b48d-3a090c2fefbd tempest-AttachInterfacesUnderV243Test-1353172127 tempest-AttachInterfacesUnderV243Test-1353172127-project-member] Enqueued Resource ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 with Priority: HIGHEST for action security_group_members [ 939.294579] env[66502]: INFO networking_nsxv3.common.synchronization [req-e720ec9c-fcce-4629-bbc1-198fcbea6132 req-754828fc-8beb-42e2-b48d-3a090c2fefbd tempest-AttachInterfacesUnderV243Test-1353172127 tempest-AttachInterfacesUnderV243Test-1353172127-project-member] Enqueued Resource ID: 70e83de1-5321-4460-b0c4-606c6cf63b1c with Priority: HIGHEST for action port [ 939.295176] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 with Priority: HIGHEST for action security_group_rules [ 939.295316] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 with Priority: HIGHEST for action security_group_members [ 939.295472] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70e83de1-5321-4460-b0c4-606c6cf63b1c with Priority: HIGHEST for action port [ 939.295822] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2728c2e7-59ab-4cf2-bc7c-4c079064da76 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.295950] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.296039] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.296454] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.296544] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2728c2e7-59ab-4cf2-bc7c-4c079064da76',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.298207] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-2728c2e7-59ab-4cf2-bc7c-4c079064da76 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.298377] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.298691] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-70e83de1-5321-4460-b0c4-606c6cf63b1c taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.298795] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70e83de1-5321-4460-b0c4-606c6cf63b1c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.298878] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70e83de1-5321-4460-b0c4-606c6cf63b1c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.299077] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70e83de1-5321-4460-b0c4-606c6cf63b1c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.299188] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70e83de1-5321-4460-b0c4-606c6cf63b1c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.672202] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: SUCCESS [ 939.672442] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.672642] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.672895] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.674902] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.675077] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.675264] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.675549] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.675697] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.675855] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.675988] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.776145] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2728c2e7-59ab-4cf2-bc7c-4c079064da76',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.802376] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 70e83de1-5321-4460-b0c4-606c6cf63b1c with status ACTIVE [ 939.802376] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.802661] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.802661] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.802821] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.802821] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.802965] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.803098] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.803355] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.803540] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.803660] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.803879] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.803999] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.804073] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.804254] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.804347] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.804455] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 70e83de1-5321-4460-b0c4-606c6cf63b1c is going to be updated. [ 939.806034] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-2728c2e7-59ab-4cf2-bc7c-4c079064da76 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.806162] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.851107] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.851766] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.851766] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.851766] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.851766] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.851973] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70e83de1-5321-4460-b0c4-606c6cf63b1c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.179025] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.179025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.179025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.179025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.179025] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.179025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.179025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.179499] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.179499] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.179499] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.179499] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.179817] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.179817] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.180193] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.180193] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.180193] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.180193] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.180317] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.181613] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.181613] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.181613] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.279101] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2728c2e7-59ab-4cf2-bc7c-4c079064da76',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.683666] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9d226a97-2d69-4706-b98b-565700008c6f: rpc.has_security_group_logging(os_id): False [ 940.705187] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.705187] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.705187] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.705187] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.731547] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.731834] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.732175] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.732175] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.732282] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.732317] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.732531] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.732632] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.732695] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.732841] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.732915] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.733107] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.733201] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.733262] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.733403] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.733479] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.733602] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d226a97-2d69-4706-b98b-565700008c6f is going to be updated. [ 940.783544] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.783544] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.783544] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.783544] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.783544] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.783544] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 is going to be updated. [ 940.821061] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.821703] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.821703] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.821703] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.821703] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.824220] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.824398] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.824481] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.824704] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.824862] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.838754] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 in Status: IN_PROGRESS for 2s [ 940.848297] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: IN_PROGRESS for 2s [ 940.949083] env[66502]: INFO networking_nsxv3.common.synchronization [req-b2a96bdf-7fc8-4e86-b341-16b4fcc98c43 req-27e633a8-1b63-4d55-a340-a4cc837985c1 tempest-MigrationsAdminTest-636676794 tempest-MigrationsAdminTest-636676794-project-member] Enqueued Resource ID: b4dfff3d-ef74-48f2-8955-b975cccf84d9 with Priority: HIGHEST for action security_group_members [ 940.949625] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4dfff3d-ef74-48f2-8955-b975cccf84d9 with Priority: HIGHEST for action security_group_members [ 940.950157] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4dfff3d-ef74-48f2-8955-b975cccf84d9 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.950510] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.950657] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.950956] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.951275] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.951460] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.951601] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.951860] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.952142] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.952246] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4dfff3d-ef74-48f2-8955-b975cccf84d9',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.455070] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b4dfff3d-ef74-48f2-8955-b975cccf84d9',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 941.959439] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b4dfff3d-ef74-48f2-8955-b975cccf84d9',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.461744] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.462191] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.462191] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.462420] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.462558] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.462698] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4dfff3d-ef74-48f2-8955-b975cccf84d9 is going to be updated. [ 942.496088] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.496238] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.496394] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.496645] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.496802] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.508346] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4dfff3d-ef74-48f2-8955-b975cccf84d9 in Status: IN_PROGRESS for 2s [ 942.547964] env[66502]: INFO networking_nsxv3.common.synchronization [req-c115610f-6f73-4e94-bcb7-8538832e98b5 req-bf387d8f-5858-4894-92ae-cf4373ea1c86 tempest-ServerRescueNegativeTestJSON-1777100369 tempest-ServerRescueNegativeTestJSON-1777100369-project-member] Enqueued Resource ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 with Priority: HIGHEST for action security_group_members [ 942.548810] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 with Priority: HIGHEST for action security_group_members [ 942.549090] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb2d9d2-95c1-4cee-98cc-8a9106959838 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.549245] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.549347] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.549668] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.549984] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.550278] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.550278] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.550555] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.550690] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.550812] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4eb2d9d2-95c1-4cee-98cc-8a9106959838',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.850724] env[66502]: INFO networking_nsxv3.common.synchronization [req-6d85c6a5-2ace-400c-ae1d-2109f1288396 req-9d45ff90-87b9-4de5-bf8f-57977eee20e0 tempest-AttachInterfacesUnderV243Test-1353172127 tempest-AttachInterfacesUnderV243Test-1353172127-project-member] Enqueued Resource ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 with Priority: HIGHEST for action security_group_members [ 942.852249] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 in Status: SUCCESS [ 942.856993] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.856993] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 with Priority: HIGHEST for action security_group_members [ 942.856993] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.856993] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.856993] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.856993] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.856993] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.856993] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.856993] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.856993] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2728c2e7-59ab-4cf2-bc7c-4c079064da76',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.858027] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-2728c2e7-59ab-4cf2-bc7c-4c079064da76 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.858027] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.876056] env[66502]: INFO networking_nsxv3.common.synchronization [req-6d85c6a5-2ace-400c-ae1d-2109f1288396 req-9d45ff90-87b9-4de5-bf8f-57977eee20e0 tempest-AttachInterfacesUnderV243Test-1353172127 tempest-AttachInterfacesUnderV243Test-1353172127-project-member] Enqueued Resource ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 with Priority: HIGHEST for action security_group_rules [ 942.876246] env[66502]: INFO networking_nsxv3.common.synchronization [req-6d85c6a5-2ace-400c-ae1d-2109f1288396 req-9d45ff90-87b9-4de5-bf8f-57977eee20e0 tempest-AttachInterfacesUnderV243Test-1353172127 tempest-AttachInterfacesUnderV243Test-1353172127-project-member] Enqueued Resource ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 with Priority: HIGHEST for action security_group_members [ 942.876416] env[66502]: INFO networking_nsxv3.common.synchronization [req-6d85c6a5-2ace-400c-ae1d-2109f1288396 req-9d45ff90-87b9-4de5-bf8f-57977eee20e0 tempest-AttachInterfacesUnderV243Test-1353172127 tempest-AttachInterfacesUnderV243Test-1353172127-project-member] Enqueued Resource ID: 70e83de1-5321-4460-b0c4-606c6cf63b1c with Priority: HIGHEST for action port [ 942.876957] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 with Priority: HIGHEST for action security_group_rules [ 942.878045] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 with Priority: HIGHEST for action security_group_members [ 942.878210] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 70e83de1-5321-4460-b0c4-606c6cf63b1c with Priority: HIGHEST for action port [ 942.879605] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: SUCCESS [ 942.880065] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.880390] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2728c2e7-59ab-4cf2-bc7c-4c079064da76 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.880523] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.880770] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-2728c2e7-59ab-4cf2-bc7c-4c079064da76 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.880915] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.881139] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-70e83de1-5321-4460-b0c4-606c6cf63b1c taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.881266] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-70e83de1-5321-4460-b0c4-606c6cf63b1c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.881594] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-70e83de1-5321-4460-b0c4-606c6cf63b1c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.881594] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-70e83de1-5321-4460-b0c4-606c6cf63b1c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.881764] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('70e83de1-5321-4460-b0c4-606c6cf63b1c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.053387] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.053588] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.053662] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.053950] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.054074] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.054332] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.054472] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.054565] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.054767] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.054852] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.054948] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 already deleted. [ 943.055073] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.335134] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-641 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.336021] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-641" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.336021] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-641" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.336397] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-641" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.340204] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.340204] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.340204] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.340204] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.340204] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.340204] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 943.340204] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 943.340204] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 943.340204] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 943.340204] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 943.340204] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 943.340204] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 943.359010] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2728c2e7-59ab-4cf2-bc7c-4c079064da76',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.384314] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 70e83de1-5321-4460-b0c4-606c6cf63b1c with status ACTIVE [ 943.385347] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.385347] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.385347] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.385347] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.385707] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.385784] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.389026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.389026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.389026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.389026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.389026] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.389026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.389026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.389026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.389026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.389026] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 70e83de1-5321-4460-b0c4-606c6cf63b1c is going to be updated. [ 943.390087] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 943.390358] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.052 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 943.390610] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 943.390842] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-641" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.391308] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-af1ef764-6478-4095-ac9c-e35ac5f3de9d taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.391545] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-af1ef764-6478-4095-ac9c-e35ac5f3de9d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.391767] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-af1ef764-6478-4095-ac9c-e35ac5f3de9d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.392194] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-af1ef764-6478-4095-ac9c-e35ac5f3de9d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.392389] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af1ef764-6478-4095-ac9c-e35ac5f3de9d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.421913] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.422151] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.422243] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.422502] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.422675] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.422862] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-70e83de1-5321-4460-b0c4-606c6cf63b1c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.861860] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2728c2e7-59ab-4cf2-bc7c-4c079064da76',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.895091] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.895323] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.895466] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.895850] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.896009] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.896173] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port af1ef764-6478-4095-ac9c-e35ac5f3de9d not found, creating... [ 943.896580] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.896736] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.896859] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.897097] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.897240] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.897586] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.897793] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.897905] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.898149] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.898348] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.898531] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: af1ef764-6478-4095-ac9c-e35ac5f3de9d is going to be created. [ 943.922593] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.922859] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.922933] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.923259] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.923553] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.923824] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-af1ef764-6478-4095-ac9c-e35ac5f3de9d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.365497] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.365720] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.365720] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.366053] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.366201] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.366366] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 is going to be updated. [ 944.405839] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.406055] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.406055] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.406306] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.406446] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.420503] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 in Status: IN_PROGRESS for 2s [ 944.525268] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4dfff3d-ef74-48f2-8955-b975cccf84d9 in Status: SUCCESS [ 944.525499] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.637179] env[66502]: INFO networking_nsxv3.common.synchronization [req-c115610f-6f73-4e94-bcb7-8538832e98b5 req-e44def09-6a66-4014-a2e6-301904fd0bf0 service nova] Enqueued Resource ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 with Priority: HIGHEST for action security_group_rules [ 944.637449] env[66502]: INFO networking_nsxv3.common.synchronization [req-c115610f-6f73-4e94-bcb7-8538832e98b5 req-e44def09-6a66-4014-a2e6-301904fd0bf0 service nova] Enqueued Resource ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 with Priority: HIGHEST for action security_group_members [ 944.637520] env[66502]: INFO networking_nsxv3.common.synchronization [req-c115610f-6f73-4e94-bcb7-8538832e98b5 req-e44def09-6a66-4014-a2e6-301904fd0bf0 service nova] Enqueued Resource ID: af1ef764-6478-4095-ac9c-e35ac5f3de9d with Priority: HIGHEST for action port [ 944.638106] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 with Priority: HIGHEST for action security_group_rules [ 944.640524] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 with Priority: HIGHEST for action security_group_members [ 944.640682] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: af1ef764-6478-4095-ac9c-e35ac5f3de9d with Priority: HIGHEST for action port [ 944.641059] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4eb2d9d2-95c1-4cee-98cc-8a9106959838 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.641191] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.641250] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.641511] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.641592] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4eb2d9d2-95c1-4cee-98cc-8a9106959838',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.642859] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb2d9d2-95c1-4cee-98cc-8a9106959838 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.642971] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.643057] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.643260] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.643400] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.643483] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.643547] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.643684] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.643765] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.643850] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4eb2d9d2-95c1-4cee-98cc-8a9106959838',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.644736] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-af1ef764-6478-4095-ac9c-e35ac5f3de9d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.644864] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-af1ef764-6478-4095-ac9c-e35ac5f3de9d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.644902] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-af1ef764-6478-4095-ac9c-e35ac5f3de9d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.645112] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-af1ef764-6478-4095-ac9c-e35ac5f3de9d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.645245] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('af1ef764-6478-4095-ac9c-e35ac5f3de9d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.147658] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb2d9d2-95c1-4cee-98cc-8a9106959838 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.148118] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.149117] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4eb2d9d2-95c1-4cee-98cc-8a9106959838',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.150369] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port af1ef764-6478-4095-ac9c-e35ac5f3de9d with status ACTIVE [ 945.150569] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.150688] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.150755] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.150959] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.151060] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.151236] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.151332] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.151395] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.151545] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.154025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.154025] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.154025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.154025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.154025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.154025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.154025] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: af1ef764-6478-4095-ac9c-e35ac5f3de9d is going to be updated. [ 945.175692] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.175973] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.175973] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.176175] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.176391] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.176615] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-af1ef764-6478-4095-ac9c-e35ac5f3de9d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.517950] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-431 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.518166] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-431" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.518289] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-431" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.518568] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-431" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.518847] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.518996] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.519122] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.519338] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.519484] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.519693] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 945.520551] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 945.520551] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 945.520551] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 945.520551] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 945.520551] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 945.520551] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 945.542387] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 945.542808] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 945.542808] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 945.543016] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-431" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.543406] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-fe23f065-e476-40d6-9fef-64739fe044f6 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.543554] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-fe23f065-e476-40d6-9fef-64739fe044f6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.543986] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-fe23f065-e476-40d6-9fef-64739fe044f6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.544415] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-fe23f065-e476-40d6-9fef-64739fe044f6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.545052] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe23f065-e476-40d6-9fef-64739fe044f6',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.619674] env[66502]: INFO networking_nsxv3.common.synchronization [req-520c1395-d761-4eb6-8db8-edd90f09a346 req-9b112113-9e1a-4e2f-8f50-8b5fb5f505ad tempest-ServersTestJSON-1210226259 tempest-ServersTestJSON-1210226259-project-member] Enqueued Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_members [ 945.620256] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_members [ 945.620761] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.620761] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.620761] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.620946] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.621113] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.621213] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.621264] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.621419] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.621507] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.621601] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.654403] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4eb2d9d2-95c1-4cee-98cc-8a9106959838',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.048750] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.049158] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.049296] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.049621] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.049775] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.050091] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.050288] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.050422] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.050598] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.050801] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.051068] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.051221] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.051342] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.051545] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.051703] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.051820] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: fe23f065-e476-40d6-9fef-64739fe044f6 is going to be updated. [ 946.082365] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.082715] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.083180] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.083279] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.083486] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.083943] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-fe23f065-e476-40d6-9fef-64739fe044f6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.123782] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.157150] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.157750] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.157854] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.158496] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.158496] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.158496] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 is going to be created. [ 946.218573] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.218573] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.218573] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.218573] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.218573] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.231382] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 in Status: UNINITIALIZED for 2s [ 946.431556] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 in Status: SUCCESS [ 946.431556] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.431754] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.431788] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.432043] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.432144] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.432718] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.432718] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.432718] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.432718] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.432718] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2728c2e7-59ab-4cf2-bc7c-4c079064da76',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.433543] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.433711] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.433872] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.434015] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.434073] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.434232] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.434305] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.434395] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2728c2e7-59ab-4cf2-bc7c-4c079064da76',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.628450] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.853361] env[66502]: INFO networking_nsxv3.common.synchronization [req-dee54f64-1137-4871-886f-c807043ce591 req-b29936c7-56eb-454b-8455-ba108e93ae32 service nova] Enqueued Resource ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a with Priority: HIGHEST for action security_group_rules [ 946.853361] env[66502]: INFO networking_nsxv3.common.synchronization [req-dee54f64-1137-4871-886f-c807043ce591 req-b29936c7-56eb-454b-8455-ba108e93ae32 service nova] Enqueued Resource ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a with Priority: HIGHEST for action security_group_members [ 946.854373] env[66502]: INFO networking_nsxv3.common.synchronization [req-dee54f64-1137-4871-886f-c807043ce591 req-b29936c7-56eb-454b-8455-ba108e93ae32 service nova] Enqueued Resource ID: fe23f065-e476-40d6-9fef-64739fe044f6 with Priority: HIGHEST for action port [ 946.855862] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a with Priority: HIGHEST for action security_group_rules [ 946.856767] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a with Priority: HIGHEST for action security_group_members [ 946.857978] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe23f065-e476-40d6-9fef-64739fe044f6 with Priority: HIGHEST for action port [ 946.857978] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ee12fee-49b0-4d1d-b52d-29888a355e8a taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.858324] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.858633] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.860234] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.860234] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ee12fee-49b0-4d1d-b52d-29888a355e8a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.861380] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ee12fee-49b0-4d1d-b52d-29888a355e8a taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.861760] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.861998] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.862411] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.862682] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.862899] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.864114] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.864114] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.864114] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 946.864114] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ee12fee-49b0-4d1d-b52d-29888a355e8a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.869041] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe23f065-e476-40d6-9fef-64739fe044f6 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 946.869041] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe23f065-e476-40d6-9fef-64739fe044f6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 946.869041] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe23f065-e476-40d6-9fef-64739fe044f6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 946.869041] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe23f065-e476-40d6-9fef-64739fe044f6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 946.869041] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe23f065-e476-40d6-9fef-64739fe044f6',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.938996] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2728c2e7-59ab-4cf2-bc7c-4c079064da76',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 946.939841] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2728c2e7-59ab-4cf2-bc7c-4c079064da76',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.132372] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.132732] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.133052] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.133052] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.133180] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.133345] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d226a97-2d69-4706-b98b-565700008c6f is going to be updated. [ 947.170066] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.170370] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.170409] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.170952] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.170952] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.182759] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: IN_PROGRESS for 2s [ 947.372859] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9ee12fee-49b0-4d1d-b52d-29888a355e8a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.374339] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ee12fee-49b0-4d1d-b52d-29888a355e8a taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.374507] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.374752] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fe23f065-e476-40d6-9fef-64739fe044f6 with status ACTIVE [ 947.375035] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.375182] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.375285] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.375610] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.375761] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.379161] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.379366] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.379460] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.379717] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.379832] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.380117] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.380251] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.380337] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.380533] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.380635] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.380747] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fe23f065-e476-40d6-9fef-64739fe044f6 is going to be updated. [ 947.410357] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.410357] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.410357] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.410357] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.410357] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.410357] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe23f065-e476-40d6-9fef-64739fe044f6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.445702] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2728c2e7-59ab-4cf2-bc7c-4c079064da76',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.445702] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2728c2e7-59ab-4cf2-bc7c-4c079064da76: rpc.has_security_group_logging(os_id): False [ 947.473030] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.473030] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.473030] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.473030] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.500580] env[66502]: INFO networking_nsxv3.common.synchronization [req-b4e07f98-08fd-41bf-88e5-0b290256b735 req-65a71ce6-0682-45f9-986d-c4f5f41112bd tempest-AttachInterfacesUnderV243Test-1353172127 tempest-AttachInterfacesUnderV243Test-1353172127-project-member] Enqueued Resource ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 with Priority: HIGHEST for action security_group_members [ 947.501229] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 with Priority: HIGHEST for action security_group_members [ 947.501551] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-2728c2e7-59ab-4cf2-bc7c-4c079064da76 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.501649] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.509274] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.509583] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.511300] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.511300] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.511300] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.511300] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.511300] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 is going to be updated. [ 947.610334] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.610687] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.610856] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.611242] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.611667] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.628554] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 in Status: IN_PROGRESS for 2s [ 947.883425] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9ee12fee-49b0-4d1d-b52d-29888a355e8a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 947.948236] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.948409] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.948524] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.948743] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.948875] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.948937] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 is going to be updated. [ 947.984033] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.984033] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.984270] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.984376] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.984549] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.996462] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 in Status: IN_PROGRESS for 2s [ 948.245436] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 in Status: SUCCESS [ 948.245436] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.245436] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.245757] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.245853] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.245931] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.245990] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.247452] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.247452] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.247452] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.247452] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4eb2d9d2-95c1-4cee-98cc-8a9106959838',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.387184] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.388957] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.388957] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.388957] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.388957] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.388957] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a is going to be updated. [ 948.430502] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.430673] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.430763] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.431326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.431326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.445377] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a in Status: IN_PROGRESS for 2s [ 948.717916] env[66502]: INFO networking_nsxv3.common.synchronization [req-3566c9ea-db66-445a-af14-427dfb52dbed req-14a8cff5-ae75-454b-84cf-dc27e88722e1 tempest-ServerRescueNegativeTestJSON-1777100369 tempest-ServerRescueNegativeTestJSON-1777100369-project-member] Enqueued Resource ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 with Priority: HIGHEST for action security_group_members [ 948.718378] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 with Priority: HIGHEST for action security_group_members [ 948.718735] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb2d9d2-95c1-4cee-98cc-8a9106959838 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.718891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.718951] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.719281] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.719486] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.719639] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.719736] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.719929] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.720055] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.720173] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4eb2d9d2-95c1-4cee-98cc-8a9106959838',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.750511] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb2d9d2-95c1-4cee-98cc-8a9106959838 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.750511] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.160106] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-641 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.160343] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-641" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.160539] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-641" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.160900] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-641" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.161437] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.161679] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.161826] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.162079] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.162229] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.162445] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 949.162604] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 949.162940] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 949.163097] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 949.163231] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 949.163348] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 949.163482] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 949.186151] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 949.186398] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 949.186643] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 949.186843] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-641" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.187332] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-bb867bb3-2ceb-4086-8c5c-7defcd9ae336 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.187484] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-bb867bb3-2ceb-4086-8c5c-7defcd9ae336" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.187577] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-bb867bb3-2ceb-4086-8c5c-7defcd9ae336" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.187913] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-bb867bb3-2ceb-4086-8c5c-7defcd9ae336" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.188068] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb867bb3-2ceb-4086-8c5c-7defcd9ae336',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.203042] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: SUCCESS [ 949.204163] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.224755] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4eb2d9d2-95c1-4cee-98cc-8a9106959838',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.641575] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 in Status: SUCCESS [ 949.641910] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.642110] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.642327] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.642415] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2728c2e7-59ab-4cf2-bc7c-4c079064da76',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.645644] env[66502]: INFO networking_nsxv3.common.synchronization [req-92b7a531-f3c0-4c8d-a326-5caeb5a555ab req-23a631aa-04ef-438f-ba99-b28f76b05b26 tempest-ServersAdminTestJSON-292997046 tempest-ServersAdminTestJSON-292997046-project-member] Enqueued Resource ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 with Priority: HIGHEST for action security_group_members [ 949.646623] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 with Priority: HIGHEST for action security_group_members [ 949.646827] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.646947] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.647037] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.647221] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.647390] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.647485] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.647552] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.647689] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.647770] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.647861] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 949.690373] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.690507] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.690712] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.691298] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.691298] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.691447] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port bb867bb3-2ceb-4086-8c5c-7defcd9ae336 not found, creating... [ 949.691682] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.691902] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.692058] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.692320] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.692490] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.692801] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.692993] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.693168] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.693711] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.693711] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.693711] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: bb867bb3-2ceb-4086-8c5c-7defcd9ae336 is going to be created. [ 949.716060] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.716361] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.716500] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.716774] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.716995] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.717267] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-bb867bb3-2ceb-4086-8c5c-7defcd9ae336" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.727282] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4eb2d9d2-95c1-4cee-98cc-8a9106959838',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.021690] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 in Status: SUCCESS [ 950.021909] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.022107] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.022389] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.022596] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.022779] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.022884] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.023088] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.023146] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.023241] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2728c2e7-59ab-4cf2-bc7c-4c079064da76',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.150054] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.169319] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.169592] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.169592] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.169675] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.169710] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.169893] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 is going to be deleted. [ 950.229570] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.229803] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.229918] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.230237] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.230406] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.230593] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 is going to be updated. [ 950.245253] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.245486] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.245579] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.245834] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.245960] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.246121] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.278544] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.278746] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.278848] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.279072] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.279225] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.290126] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 in Status: IN_PROGRESS for 2s [ 950.452319] env[66502]: INFO networking_nsxv3.common.synchronization [req-3566c9ea-db66-445a-af14-427dfb52dbed req-c15aac80-b293-4d41-97e6-987ce3dba1ee service nova] Enqueued Resource ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 with Priority: HIGHEST for action security_group_rules [ 950.452509] env[66502]: INFO networking_nsxv3.common.synchronization [req-3566c9ea-db66-445a-af14-427dfb52dbed req-c15aac80-b293-4d41-97e6-987ce3dba1ee service nova] Enqueued Resource ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 with Priority: HIGHEST for action security_group_members [ 950.452664] env[66502]: INFO networking_nsxv3.common.synchronization [req-3566c9ea-db66-445a-af14-427dfb52dbed req-c15aac80-b293-4d41-97e6-987ce3dba1ee service nova] Enqueued Resource ID: bb867bb3-2ceb-4086-8c5c-7defcd9ae336 with Priority: HIGHEST for action port [ 950.453682] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 with Priority: HIGHEST for action security_group_rules [ 950.453823] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 with Priority: HIGHEST for action security_group_members [ 950.453920] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bb867bb3-2ceb-4086-8c5c-7defcd9ae336 with Priority: HIGHEST for action port [ 950.454226] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4eb2d9d2-95c1-4cee-98cc-8a9106959838 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.454330] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.454522] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb2d9d2-95c1-4cee-98cc-8a9106959838 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.454603] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.454779] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-bb867bb3-2ceb-4086-8c5c-7defcd9ae336 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.454879] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bb867bb3-2ceb-4086-8c5c-7defcd9ae336" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.454941] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bb867bb3-2ceb-4086-8c5c-7defcd9ae336" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.455160] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bb867bb3-2ceb-4086-8c5c-7defcd9ae336" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.456820] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bb867bb3-2ceb-4086-8c5c-7defcd9ae336',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.461395] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a in Status: SUCCESS [ 950.461656] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.461835] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.462099] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.462548] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.462857] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.462857] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.462954] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.462990] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.463081] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.463212] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9ee12fee-49b0-4d1d-b52d-29888a355e8a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.526695] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.526904] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.526980] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.527219] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.527310] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.527528] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.527633] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.527697] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.527868] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.527947] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.528046] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 is going to be deleted. [ 950.561984] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.562181] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.562228] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.562424] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.562520] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.562631] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.562808] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.563024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.563138] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.563234] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.563296] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.563435] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.563510] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.563601] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2728c2e7-59ab-4cf2-bc7c-4c079064da76',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.652413] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.960022] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bb867bb3-2ceb-4086-8c5c-7defcd9ae336 with status ACTIVE [ 950.960022] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.960022] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.960022] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.960022] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.960022] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.960365] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.960365] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.960365] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.960522] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.960522] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.960709] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.960836] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.960870] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.961008] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.961087] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.961187] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bb867bb3-2ceb-4086-8c5c-7defcd9ae336 is going to be updated. [ 950.966596] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ee12fee-49b0-4d1d-b52d-29888a355e8a taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.966764] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.966836] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.967948] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.967948] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.967948] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.967948] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.967948] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.967948] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.967948] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.968283] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ee12fee-49b0-4d1d-b52d-29888a355e8a taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.968283] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.968283] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.968381] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.968522] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.968585] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.968585] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.968721] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.968805] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.968895] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.968965] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9ee12fee-49b0-4d1d-b52d-29888a355e8a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.987664] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.988285] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.988374] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.988639] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.988742] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.988967] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bb867bb3-2ceb-4086-8c5c-7defcd9ae336" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.066017] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.066215] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.066287] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.066641] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.066734] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.066987] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.067191] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.067191] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.067460] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.067460] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.067574] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2728c2e7-59ab-4cf2-bc7c-4c079064da76 already deleted. [ 951.067789] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2728c2e7-59ab-4cf2-bc7c-4c079064da76" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.156252] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.156526] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.156588] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.156788] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.156877] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.156976] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 is going to be updated. [ 951.196863] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.197072] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.197189] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.197542] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.197738] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.215327] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 in Status: IN_PROGRESS for 2s [ 951.473068] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9ee12fee-49b0-4d1d-b52d-29888a355e8a: rpc.has_security_group_logging(os_id): False [ 951.509485] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.509485] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.509485] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.509485] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.549031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.549031] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.549031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.549031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.549031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.549031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.549031] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.549031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.549031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.549031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.549031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.549031] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.549031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.549031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.549649] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.549649] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.549649] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a is going to be updated. [ 951.697859] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.698181] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.698181] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.698337] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.698525] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.712642] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a in Status: IN_PROGRESS for 2s [ 952.312588] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 in Status: SUCCESS [ 952.312824] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.313140] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.313408] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.313639] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.313791] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.313876] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.314082] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.314203] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.314318] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.314584] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb2d9d2-95c1-4cee-98cc-8a9106959838 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.314756] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.314899] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.315100] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.315319] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.315488] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.315598] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.315826] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.315964] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.316128] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.316283] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4eb2d9d2-95c1-4cee-98cc-8a9106959838',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.317420] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.317660] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.317904] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.318094] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.318364] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.318364] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.318518] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.318670] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4eb2d9d2-95c1-4cee-98cc-8a9106959838',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.820581] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4eb2d9d2-95c1-4cee-98cc-8a9106959838: rpc.has_security_group_logging(os_id): False [ 952.822216] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4eb2d9d2-95c1-4cee-98cc-8a9106959838',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.844205] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.844330] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.844330] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.844576] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.844668] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.844874] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.844966] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.849024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.849024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.849024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.849024] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.849024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.849024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.849024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.849024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.849024] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.849024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.849024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.849024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.849024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.849024] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 is going to be created. [ 952.925703] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.925860] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.926720] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.926720] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.926720] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.945649] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 in Status: IN_PROGRESS for 2s [ 953.228529] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 in Status: SUCCESS [ 953.228811] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.324635] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4eb2d9d2-95c1-4cee-98cc-8a9106959838',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.728879] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a in Status: SUCCESS [ 953.729039] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.829880] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.830320] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.830320] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.830580] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.830740] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.830866] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 is going to be updated. [ 953.880835] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.880835] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.880835] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.880835] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.880835] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.898806] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 in Status: IN_PROGRESS for 2s [ 954.965369] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 in Status: SUCCESS [ 954.965369] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.965809] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.965809] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.965809] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4eb2d9d2-95c1-4cee-98cc-8a9106959838',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.454506] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 955.454656] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 955.472614] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb2d9d2-95c1-4cee-98cc-8a9106959838 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.472820] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.912891] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 in Status: SUCCESS [ 955.913145] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.913329] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.913593] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.913829] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.913973] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.914060] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.914288] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.914439] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.914439] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.914501] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4eb2d9d2-95c1-4cee-98cc-8a9106959838',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.416924] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb2d9d2-95c1-4cee-98cc-8a9106959838 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.417449] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.417449] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.417646] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.417884] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.418081] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.418187] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.418460] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.418604] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.418827] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.419107] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb2d9d2-95c1-4cee-98cc-8a9106959838 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.419264] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.419361] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.419587] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.419755] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.419859] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.419922] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.420099] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.420185] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.420270] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.420364] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4eb2d9d2-95c1-4cee-98cc-8a9106959838',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.528283] env[66502]: INFO networking_nsxv3.common.synchronization [req-9a5585da-2d6e-4380-bbb6-df01ab62c26e req-756aaebf-33dd-4851-97e0-ea5cc3506732 tempest-SecurityGroupsTestJSON-779026578 tempest-SecurityGroupsTestJSON-779026578-project-member] Enqueued Resource ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d with Priority: HIGHEST for action security_group_members [ 956.528470] env[66502]: INFO networking_nsxv3.common.synchronization [req-9a5585da-2d6e-4380-bbb6-df01ab62c26e req-756aaebf-33dd-4851-97e0-ea5cc3506732 tempest-SecurityGroupsTestJSON-779026578 tempest-SecurityGroupsTestJSON-779026578-project-member] Enqueued Resource ID: 4dd503d7-4db7-4af2-b850-79a736ef1ddc with Priority: HIGHEST for action security_group_members [ 956.528603] env[66502]: INFO networking_nsxv3.common.synchronization [req-9a5585da-2d6e-4380-bbb6-df01ab62c26e req-756aaebf-33dd-4851-97e0-ea5cc3506732 tempest-SecurityGroupsTestJSON-779026578 tempest-SecurityGroupsTestJSON-779026578-project-member] Enqueued Resource ID: dc23d7c3-5dc4-486e-83b2-d32fa7298233 with Priority: HIGHEST for action security_group_members [ 956.529202] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d with Priority: HIGHEST for action security_group_members [ 956.529889] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4dd503d7-4db7-4af2-b850-79a736ef1ddc with Priority: HIGHEST for action security_group_members [ 956.529889] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc23d7c3-5dc4-486e-83b2-d32fa7298233 with Priority: HIGHEST for action security_group_members [ 956.529889] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.530087] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.530087] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.530198] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.530363] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.530683] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.530683] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.530683] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.530855] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.530855] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.532173] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4dd503d7-4db7-4af2-b850-79a736ef1ddc taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.532409] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4dd503d7-4db7-4af2-b850-79a736ef1ddc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.532455] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4dd503d7-4db7-4af2-b850-79a736ef1ddc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.532626] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4dd503d7-4db7-4af2-b850-79a736ef1ddc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.532780] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.532882] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.532947] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.533113] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.533202] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.533299] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4dd503d7-4db7-4af2-b850-79a736ef1ddc',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.534226] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-dc23d7c3-5dc4-486e-83b2-d32fa7298233 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.534325] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-dc23d7c3-5dc4-486e-83b2-d32fa7298233" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.534398] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-dc23d7c3-5dc4-486e-83b2-d32fa7298233" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.534571] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-dc23d7c3-5dc4-486e-83b2-d32fa7298233" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.534786] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.534855] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.534895] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.535035] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.535121] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.535215] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('dc23d7c3-5dc4-486e-83b2-d32fa7298233',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.922804] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4eb2d9d2-95c1-4cee-98cc-8a9106959838: rpc.has_security_group_logging(os_id): False [ 956.944731] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.944731] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.948166] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.948166] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.948166] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.948166] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.948166] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.948166] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.948166] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.948166] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.948166] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.948166] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.948166] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.948166] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.948166] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.948166] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.948957] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.948957] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.948957] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.948957] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.948957] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 is going to be updated. [ 957.038484] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.038661] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.038720] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.039054] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.040454] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.040590] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.040858] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.040929] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.044885] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.045046] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.077204] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.077557] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.077690] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.077807] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.078039] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.078137] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.078229] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dd503d7-4db7-4af2-b850-79a736ef1ddc is going to be updated. [ 957.079500] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.079779] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.079879] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.080107] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.080219] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.080284] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.080433] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.080510] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.080595] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d is going to be updated. [ 957.081477] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.081636] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.114249] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.114561] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.114738] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.114738] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.114944] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.115030] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.115126] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc23d7c3-5dc4-486e-83b2-d32fa7298233 is going to be updated. [ 957.116958] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.117317] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.117659] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.210215] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.210215] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.210215] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.210215] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.210568] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.225853] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 in Status: IN_PROGRESS for 2s [ 957.245796] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dd503d7-4db7-4af2-b850-79a736ef1ddc in Status: IN_PROGRESS for 2s [ 957.251580] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.251580] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.251580] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.251580] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.251580] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.271029] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d in Status: IN_PROGRESS for 2s [ 957.275223] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.275405] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.275453] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.275655] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.275813] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.299118] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc23d7c3-5dc4-486e-83b2-d32fa7298233 in Status: IN_PROGRESS for 2s [ 958.239363] env[66502]: INFO networking_nsxv3.common.synchronization [req-91c141d5-068b-4428-bfc5-46fe52c68246 req-33f67e85-313d-4d29-ac24-37f2e15ea47a tempest-ImagesTestJSON-1088460097 tempest-ImagesTestJSON-1088460097-project-member] Enqueued Resource ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 with Priority: HIGHEST for action security_group_members [ 958.240228] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 with Priority: HIGHEST for action security_group_members [ 958.240553] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.240677] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.240751] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.240946] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.241419] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.241537] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.241602] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.241775] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.241862] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.241958] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.748383] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.748383] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.748383] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.748383] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.776082] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.776082] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.776082] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.776082] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.776082] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.776082] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.776082] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 is going to be updated. [ 958.837029] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.837305] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.837305] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.837482] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.837622] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.850702] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 in Status: IN_PROGRESS for 2s [ 959.273422] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4dd503d7-4db7-4af2-b850-79a736ef1ddc in Status: SUCCESS [ 959.273695] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4dd503d7-4db7-4af2-b850-79a736ef1ddc deletion is rescheduled due to dependency. [ 959.273752] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4dd503d7-4db7-4af2-b850-79a736ef1ddc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.276224] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 in Status: SUCCESS [ 959.276454] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.292077] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d in Status: SUCCESS [ 959.292812] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d deletion is rescheduled due to dependency. [ 959.292812] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.315473] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: dc23d7c3-5dc4-486e-83b2-d32fa7298233 in Status: SUCCESS [ 959.317416] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: dc23d7c3-5dc4-486e-83b2-d32fa7298233 deletion is rescheduled due to dependency. [ 959.317416] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-dc23d7c3-5dc4-486e-83b2-d32fa7298233" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.261267] env[66502]: INFO networking_nsxv3.common.synchronization [None req-ea9e3a08-5dd7-4de6-be6e-28de7983a149 tempest-AttachVolumeNegativeTest-686526601 tempest-AttachVolumeNegativeTest-686526601-project-member] Enqueued Resource ID: cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66 with Priority: HIGHEST for action security_group_rules [ 960.262176] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66 with Priority: HIGHEST for action security_group_rules [ 960.262659] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.262849] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.262962] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.263352] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.263499] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.363330] env[66502]: INFO networking_nsxv3.common.synchronization [None req-74edec2f-16ba-4395-9043-a00267afac39 tempest-AttachVolumeNegativeTest-686526601 tempest-AttachVolumeNegativeTest-686526601-project-member] Enqueued Resource ID: cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66 with Priority: HIGHEST for action security_group_rules [ 960.363934] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66 with Priority: HIGHEST for action security_group_rules [ 960.364283] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.364397] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.792018] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.792966] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.793077] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.793695] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.793695] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.793695] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66 already deleted. [ 960.793695] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.793896] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.793896] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.793965] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.866157] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 in Status: SUCCESS [ 960.866157] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 deletion is rescheduled due to dependency. [ 960.866157] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.316214] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.316294] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.316382] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.316656] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.316771] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.316845] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66 already deleted. [ 961.316988] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.133137] env[66502]: INFO networking_nsxv3.common.synchronization [req-eee439c2-3dbb-4b85-b27d-394e01813d95 req-6ab58922-5cb6-4a6e-95e0-64cabb98d733 tempest-ServerAddressesNegativeTestJSON-893336517 tempest-ServerAddressesNegativeTestJSON-893336517-project-member] Enqueued Resource ID: 38951171-ba5a-4a21-9804-7356a9fd37d5 with Priority: HIGHEST for action security_group_members [ 962.133754] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38951171-ba5a-4a21-9804-7356a9fd37d5 with Priority: HIGHEST for action security_group_members [ 962.135845] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-38951171-ba5a-4a21-9804-7356a9fd37d5 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.136056] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38951171-ba5a-4a21-9804-7356a9fd37d5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.136118] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38951171-ba5a-4a21-9804-7356a9fd37d5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.136442] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38951171-ba5a-4a21-9804-7356a9fd37d5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.136744] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.136901] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.137024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.137297] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.137450] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.137611] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38951171-ba5a-4a21-9804-7356a9fd37d5',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 962.643018] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.643018] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.643018] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.643018] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.643018] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.643018] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.643018] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.643018] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.643018] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.643018] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.643414] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38951171-ba5a-4a21-9804-7356a9fd37d5 already deleted. [ 962.643414] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38951171-ba5a-4a21-9804-7356a9fd37d5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.711670] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-12 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.711670] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-12" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.711997] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-12" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.712185] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-12" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.712466] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.712654] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.712779] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.712999] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.713189] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.713428] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 962.713505] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 962.713609] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 962.713754] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 962.713837] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 962.713936] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 962.714128] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 962.740149] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 962.740149] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 962.740149] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 962.740149] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-12" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.740149] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-103f8938-a0c5-4051-9d45-7a82a5fac4e3 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.740367] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-103f8938-a0c5-4051-9d45-7a82a5fac4e3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.740367] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-103f8938-a0c5-4051-9d45-7a82a5fac4e3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.741027] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-103f8938-a0c5-4051-9d45-7a82a5fac4e3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.741027] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('103f8938-a0c5-4051-9d45-7a82a5fac4e3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.247369] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.247369] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.247369] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.247369] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.247369] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.247369] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 103f8938-a0c5-4051-9d45-7a82a5fac4e3 not found, creating... [ 963.247369] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.247369] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.247369] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.247369] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.247369] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.248131] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.248131] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.248131] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.248436] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.248751] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.249054] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 103f8938-a0c5-4051-9d45-7a82a5fac4e3 is going to be created. [ 963.283846] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.283846] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.283846] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.284084] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.284258] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.284556] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-103f8938-a0c5-4051-9d45-7a82a5fac4e3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.012007] env[66502]: INFO networking_nsxv3.common.synchronization [req-eee439c2-3dbb-4b85-b27d-394e01813d95 req-02570243-4df2-44c9-96b8-4b272cd1ffa0 service nova] Enqueued Resource ID: 38951171-ba5a-4a21-9804-7356a9fd37d5 with Priority: HIGHEST for action security_group_rules [ 964.012266] env[66502]: INFO networking_nsxv3.common.synchronization [req-eee439c2-3dbb-4b85-b27d-394e01813d95 req-02570243-4df2-44c9-96b8-4b272cd1ffa0 service nova] Enqueued Resource ID: 38951171-ba5a-4a21-9804-7356a9fd37d5 with Priority: HIGHEST for action security_group_members [ 964.012417] env[66502]: INFO networking_nsxv3.common.synchronization [req-eee439c2-3dbb-4b85-b27d-394e01813d95 req-02570243-4df2-44c9-96b8-4b272cd1ffa0 service nova] Enqueued Resource ID: 103f8938-a0c5-4051-9d45-7a82a5fac4e3 with Priority: HIGHEST for action port [ 964.013115] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38951171-ba5a-4a21-9804-7356a9fd37d5 with Priority: HIGHEST for action security_group_rules [ 964.013224] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38951171-ba5a-4a21-9804-7356a9fd37d5 with Priority: HIGHEST for action security_group_members [ 964.013363] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 103f8938-a0c5-4051-9d45-7a82a5fac4e3 with Priority: HIGHEST for action port [ 964.013665] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38951171-ba5a-4a21-9804-7356a9fd37d5 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.013845] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38951171-ba5a-4a21-9804-7356a9fd37d5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.013908] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38951171-ba5a-4a21-9804-7356a9fd37d5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.014205] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38951171-ba5a-4a21-9804-7356a9fd37d5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.014301] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38951171-ba5a-4a21-9804-7356a9fd37d5',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.015210] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-38951171-ba5a-4a21-9804-7356a9fd37d5 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.015313] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38951171-ba5a-4a21-9804-7356a9fd37d5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.015376] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38951171-ba5a-4a21-9804-7356a9fd37d5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.015546] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38951171-ba5a-4a21-9804-7356a9fd37d5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.015727] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.015829] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.015829] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.015986] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.016074] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.016154] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38951171-ba5a-4a21-9804-7356a9fd37d5',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.016925] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-103f8938-a0c5-4051-9d45-7a82a5fac4e3 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.017091] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-103f8938-a0c5-4051-9d45-7a82a5fac4e3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.017148] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-103f8938-a0c5-4051-9d45-7a82a5fac4e3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.017265] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-103f8938-a0c5-4051-9d45-7a82a5fac4e3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.017339] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('103f8938-a0c5-4051-9d45-7a82a5fac4e3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.519198] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-38951171-ba5a-4a21-9804-7356a9fd37d5 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.519600] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38951171-ba5a-4a21-9804-7356a9fd37d5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.519600] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('38951171-ba5a-4a21-9804-7356a9fd37d5',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.521156] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 103f8938-a0c5-4051-9d45-7a82a5fac4e3 with status ACTIVE [ 964.521156] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.521156] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.521156] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.521467] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.521467] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.522822] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.523384] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.523490] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.523690] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.523779] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.523977] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.524166] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.524166] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.524310] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.524400] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.524489] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 103f8938-a0c5-4051-9d45-7a82a5fac4e3 is going to be updated. [ 964.549711] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.549885] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.549932] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.550129] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.550275] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.550424] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-103f8938-a0c5-4051-9d45-7a82a5fac4e3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.028033] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('38951171-ba5a-4a21-9804-7356a9fd37d5',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.444209] env[66502]: INFO networking_nsxv3.common.synchronization [None req-4ab719d4-b5cf-422d-a572-1f6089bd1e89 None None] Enqueued Resource ID: 2daefc6b-27e6-4084-b081-ca70a8ad753f with Priority: HIGHEST for action port [ 965.444921] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2daefc6b-27e6-4084-b081-ca70a8ad753f with Priority: HIGHEST for action port [ 965.445263] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-2daefc6b-27e6-4084-b081-ca70a8ad753f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.445384] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2daefc6b-27e6-4084-b081-ca70a8ad753f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.445454] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2daefc6b-27e6-4084-b081-ca70a8ad753f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.445760] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2daefc6b-27e6-4084-b081-ca70a8ad753f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.445844] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2daefc6b-27e6-4084-b081-ca70a8ad753f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.532528] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.532924] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.532924] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.533144] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.533259] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.533385] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38951171-ba5a-4a21-9804-7356a9fd37d5 is going to be created. [ 965.569033] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.569033] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.569033] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.569319] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.569319] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.582300] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38951171-ba5a-4a21-9804-7356a9fd37d5 in Status: UNINITIALIZED for 2s [ 965.947880] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2daefc6b-27e6-4084-b081-ca70a8ad753f [ 965.948159] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.948293] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.948340] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.948572] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.949338] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.949338] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2daefc6b-27e6-4084-b081-ca70a8ad753f already deleted. [ 965.949338] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2daefc6b-27e6-4084-b081-ca70a8ad753f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.595712] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38951171-ba5a-4a21-9804-7356a9fd37d5 in Status: SUCCESS [ 967.597064] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38951171-ba5a-4a21-9804-7356a9fd37d5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.597064] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38951171-ba5a-4a21-9804-7356a9fd37d5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.597064] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38951171-ba5a-4a21-9804-7356a9fd37d5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.597064] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.597064] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.597543] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.597543] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.597624] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.597762] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38951171-ba5a-4a21-9804-7356a9fd37d5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.597910] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('38951171-ba5a-4a21-9804-7356a9fd37d5',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.100120] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-38951171-ba5a-4a21-9804-7356a9fd37d5 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.100323] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38951171-ba5a-4a21-9804-7356a9fd37d5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.100377] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38951171-ba5a-4a21-9804-7356a9fd37d5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.102020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38951171-ba5a-4a21-9804-7356a9fd37d5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.102020] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.102020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.102020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.102020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.102020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.102020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38951171-ba5a-4a21-9804-7356a9fd37d5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.102020] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-38951171-ba5a-4a21-9804-7356a9fd37d5 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.102020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38951171-ba5a-4a21-9804-7356a9fd37d5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.102020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38951171-ba5a-4a21-9804-7356a9fd37d5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.102020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38951171-ba5a-4a21-9804-7356a9fd37d5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.102020] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.102020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.102020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.102604] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.102604] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.102604] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38951171-ba5a-4a21-9804-7356a9fd37d5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.102604] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('38951171-ba5a-4a21-9804-7356a9fd37d5',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.607410] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 38951171-ba5a-4a21-9804-7356a9fd37d5: rpc.has_security_group_logging(os_id): False [ 968.625041] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.625202] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.625279] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.625499] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.625594] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.625814] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.625911] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.625981] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.626143] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.626225] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.626425] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.626541] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.626612] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.626753] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.626823] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.631279] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.631279] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.631279] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.631279] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.631704] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.632095] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38951171-ba5a-4a21-9804-7356a9fd37d5 is going to be created. [ 968.717326] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.717326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.717326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.717326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.717326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.730806] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 38951171-ba5a-4a21-9804-7356a9fd37d5 in Status: IN_PROGRESS for 2s [ 970.446244] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 970.446244] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 970.750088] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 38951171-ba5a-4a21-9804-7356a9fd37d5 in Status: SUCCESS [ 970.750088] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38951171-ba5a-4a21-9804-7356a9fd37d5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.324253] env[66502]: INFO networking_nsxv3.common.synchronization [None req-d162181e-eb88-4f0d-9ef3-88dc3448bc7f None None] Enqueued Resource ID: 778b7f08-5c0c-4e1a-9594-b1468a8a0232 with Priority: HIGHEST for action port [ 971.324954] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 778b7f08-5c0c-4e1a-9594-b1468a8a0232 with Priority: HIGHEST for action port [ 971.325544] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-778b7f08-5c0c-4e1a-9594-b1468a8a0232 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.325544] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-778b7f08-5c0c-4e1a-9594-b1468a8a0232" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.325714] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-778b7f08-5c0c-4e1a-9594-b1468a8a0232" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.325952] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-778b7f08-5c0c-4e1a-9594-b1468a8a0232" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.326122] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('778b7f08-5c0c-4e1a-9594-b1468a8a0232',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.829105] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 778b7f08-5c0c-4e1a-9594-b1468a8a0232 [ 971.829443] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.829443] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.829536] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.829729] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.829877] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.829935] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:778b7f08-5c0c-4e1a-9594-b1468a8a0232 already deleted. [ 971.830024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-778b7f08-5c0c-4e1a-9594-b1468a8a0232" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.909033] env[66502]: INFO networking_nsxv3.common.synchronization [req-17ac33db-aa17-473d-a4d7-b4bf92c3900c req-95460644-831b-4733-9ff1-fd34a8fd82b5 tempest-DeleteServersTestJSON-51385704 tempest-DeleteServersTestJSON-51385704-project-member] Enqueued Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_members [ 971.909676] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_members [ 971.910060] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-704e5eab-aa44-4493-8c9a-0b24250e7bea taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.910209] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.910291] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.910502] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.910657] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.910750] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.910807] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.910949] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.911061] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.911194] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.415275] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.415440] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.415484] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.415718] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.446508] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.446508] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.446508] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.446508] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.446508] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.446508] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.446508] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea is going to be updated. [ 972.482458] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.482660] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.482709] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.482953] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.483545] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.494541] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: IN_PROGRESS for 2s [ 972.848061] env[66502]: INFO networking_nsxv3.common.synchronization [None req-bd9c437e-a660-42d1-8497-1fd7e44062f9 tempest-ServersTestJSON-832869893 tempest-ServersTestJSON-832869893-project-member] Enqueued Resource ID: 14ec965c-75b2-4d76-849a-5e823fe2adcd with Priority: HIGHEST for action security_group_rules [ 972.848746] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14ec965c-75b2-4d76-849a-5e823fe2adcd with Priority: HIGHEST for action security_group_rules [ 972.849201] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14ec965c-75b2-4d76-849a-5e823fe2adcd taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.849201] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14ec965c-75b2-4d76-849a-5e823fe2adcd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.850689] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14ec965c-75b2-4d76-849a-5e823fe2adcd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.850689] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14ec965c-75b2-4d76-849a-5e823fe2adcd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.850689] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14ec965c-75b2-4d76-849a-5e823fe2adcd',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.006979] env[66502]: INFO networking_nsxv3.common.synchronization [None req-4e59c7c5-fc9e-4f70-bb70-a1e02c27c82b tempest-ServersTestJSON-832869893 tempest-ServersTestJSON-832869893-project-member] Enqueued Resource ID: 14ec965c-75b2-4d76-849a-5e823fe2adcd with Priority: HIGHEST for action security_group_rules [ 973.010605] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14ec965c-75b2-4d76-849a-5e823fe2adcd with Priority: HIGHEST for action security_group_rules [ 973.010605] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14ec965c-75b2-4d76-849a-5e823fe2adcd taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.010605] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14ec965c-75b2-4d76-849a-5e823fe2adcd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.377627] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.377627] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.377627] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.377627] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.377627] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.378198] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14ec965c-75b2-4d76-849a-5e823fe2adcd already deleted. [ 973.378198] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14ec965c-75b2-4d76-849a-5e823fe2adcd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.378198] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14ec965c-75b2-4d76-849a-5e823fe2adcd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.378198] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14ec965c-75b2-4d76-849a-5e823fe2adcd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.378198] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14ec965c-75b2-4d76-849a-5e823fe2adcd',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.767401] env[66502]: INFO networking_nsxv3.common.synchronization [None req-2c682b53-4a8a-4205-85a3-73126ce4f152 None None] Enqueued Resource ID: 41f4b941-d3f4-4d72-9658-813e87779f1e with Priority: HIGHEST for action port [ 973.767850] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41f4b941-d3f4-4d72-9658-813e87779f1e with Priority: HIGHEST for action port [ 973.768202] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-41f4b941-d3f4-4d72-9658-813e87779f1e taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.769482] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41f4b941-d3f4-4d72-9658-813e87779f1e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.769482] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41f4b941-d3f4-4d72-9658-813e87779f1e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.769482] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41f4b941-d3f4-4d72-9658-813e87779f1e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.769482] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41f4b941-d3f4-4d72-9658-813e87779f1e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.882054] env[66502]: INFO networking_nsxv3.common.synchronization [None req-32052ef1-547c-48f7-ae92-b480c5b7f9e9 None None] Enqueued Resource ID: b83be5f5-0e49-44b3-ba7d-53b251022634 with Priority: HIGHEST for action port [ 973.883676] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b83be5f5-0e49-44b3-ba7d-53b251022634 with Priority: HIGHEST for action port [ 973.884108] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-b83be5f5-0e49-44b3-ba7d-53b251022634 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.884206] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b83be5f5-0e49-44b3-ba7d-53b251022634" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.884239] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b83be5f5-0e49-44b3-ba7d-53b251022634" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.884501] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b83be5f5-0e49-44b3-ba7d-53b251022634" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.884585] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b83be5f5-0e49-44b3-ba7d-53b251022634',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 973.903651] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.903839] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.903973] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.904144] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.904576] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.904576] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14ec965c-75b2-4d76-849a-5e823fe2adcd already deleted. [ 973.904576] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14ec965c-75b2-4d76-849a-5e823fe2adcd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.271024] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 41f4b941-d3f4-4d72-9658-813e87779f1e [ 974.271364] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.271543] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.271788] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.272078] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.272237] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.272350] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:41f4b941-d3f4-4d72-9658-813e87779f1e already deleted. [ 974.272460] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41f4b941-d3f4-4d72-9658-813e87779f1e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.388537] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b83be5f5-0e49-44b3-ba7d-53b251022634 [ 974.388741] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.388872] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.388936] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.389181] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.389275] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.389379] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b83be5f5-0e49-44b3-ba7d-53b251022634 already deleted. [ 974.389469] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b83be5f5-0e49-44b3-ba7d-53b251022634" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.505944] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: SUCCESS [ 974.506172] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea deletion is rescheduled due to dependency. [ 974.506292] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.899027] env[66502]: INFO networking_nsxv3.common.synchronization [req-0d9b06bc-c7cd-46e9-a435-a3236c8c6bbc req-93e1ff12-c178-4fea-a855-c485bf522bbc tempest-ServerActionsTestJSON-2133613622 tempest-ServerActionsTestJSON-2133613622-project-member] Enqueued Resource ID: b10a43dc-2d28-4687-a424-05a1ebdfa3c3 with Priority: HIGHEST for action security_group_members [ 977.907068] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b10a43dc-2d28-4687-a424-05a1ebdfa3c3 with Priority: HIGHEST for action security_group_members [ 977.908085] env[66502]: INFO networking_nsxv3.common.synchronization [None req-b004369c-dcb4-4b7f-84bd-5ec77fbf8c10 None None] Enqueued Resource ID: 67348682-a620-4429-a42e-8be3affd6000 with Priority: HIGHEST for action port [ 977.908971] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b10a43dc-2d28-4687-a424-05a1ebdfa3c3 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.909386] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b10a43dc-2d28-4687-a424-05a1ebdfa3c3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.909386] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b10a43dc-2d28-4687-a424-05a1ebdfa3c3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.909386] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b10a43dc-2d28-4687-a424-05a1ebdfa3c3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.909604] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.909689] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.909689] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.910795] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.910795] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.910795] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b10a43dc-2d28-4687-a424-05a1ebdfa3c3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.912694] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67348682-a620-4429-a42e-8be3affd6000 with Priority: HIGHEST for action port [ 977.916905] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-67348682-a620-4429-a42e-8be3affd6000 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.916905] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-67348682-a620-4429-a42e-8be3affd6000" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.916905] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-67348682-a620-4429-a42e-8be3affd6000" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.916905] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-67348682-a620-4429-a42e-8be3affd6000" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.916905] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('67348682-a620-4429-a42e-8be3affd6000',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.083134] env[66502]: INFO networking_nsxv3.common.synchronization [req-f39d255e-9ca7-4b7a-961f-c9753a0f950d req-365ad85e-49f2-4ab9-a763-d971cb90c4af tempest-MigrationsAdminTest-636676794 tempest-MigrationsAdminTest-636676794-project-member] Enqueued Resource ID: b4dfff3d-ef74-48f2-8955-b975cccf84d9 with Priority: HIGHEST for action security_group_members [ 978.083921] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4dfff3d-ef74-48f2-8955-b975cccf84d9 with Priority: HIGHEST for action security_group_members [ 978.084415] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b4dfff3d-ef74-48f2-8955-b975cccf84d9 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.084591] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.085317] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.085569] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.085828] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.086768] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.086768] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.086768] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.086768] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.086768] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b4dfff3d-ef74-48f2-8955-b975cccf84d9',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.418026] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.418026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.418026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.418026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.418026] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 67348682-a620-4429-a42e-8be3affd6000 [ 978.418026] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.418489] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.418489] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.418553] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.418639] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.418783] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:67348682-a620-4429-a42e-8be3affd6000 already deleted. [ 978.418887] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-67348682-a620-4429-a42e-8be3affd6000" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.443122] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.443122] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.443122] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.443122] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.443122] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.443122] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.443122] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b10a43dc-2d28-4687-a424-05a1ebdfa3c3 is going to be updated. [ 978.483938] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.483938] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.483938] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.483938] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.483938] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.496092] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b10a43dc-2d28-4687-a424-05a1ebdfa3c3 in Status: IN_PROGRESS for 2s [ 978.593159] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.593159] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.593159] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.593159] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.620912] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.621290] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.621411] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.621448] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.621650] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.621737] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.621827] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4dfff3d-ef74-48f2-8955-b975cccf84d9 is going to be updated. [ 978.682738] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.682738] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.682738] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.682738] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.682738] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.693239] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4dfff3d-ef74-48f2-8955-b975cccf84d9 in Status: IN_PROGRESS for 2s [ 979.414549] env[66502]: INFO networking_nsxv3.common.synchronization [req-09394187-0c45-4dfc-9116-5efacb592a30 req-c76adf2a-82f2-4f68-8376-32b95b0e143d tempest-ServerAddressesNegativeTestJSON-893336517 tempest-ServerAddressesNegativeTestJSON-893336517-project-member] Enqueued Resource ID: 38951171-ba5a-4a21-9804-7356a9fd37d5 with Priority: HIGHEST for action security_group_members [ 979.417899] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38951171-ba5a-4a21-9804-7356a9fd37d5 with Priority: HIGHEST for action security_group_members [ 979.417899] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-38951171-ba5a-4a21-9804-7356a9fd37d5 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.417899] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-38951171-ba5a-4a21-9804-7356a9fd37d5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.417899] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-38951171-ba5a-4a21-9804-7356a9fd37d5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.417899] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-38951171-ba5a-4a21-9804-7356a9fd37d5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.417899] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.417899] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.417899] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.417899] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.417899] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.417899] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('38951171-ba5a-4a21-9804-7356a9fd37d5',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.920463] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.920463] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.920463] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.920636] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.920667] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.920892] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.921021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.921108] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.921237] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.921354] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.921407] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38951171-ba5a-4a21-9804-7356a9fd37d5 is going to be updated. [ 979.993765] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.993765] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.993765] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.994062] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.994629] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.014270] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38951171-ba5a-4a21-9804-7356a9fd37d5 in Status: IN_PROGRESS for 2s [ 980.509776] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b10a43dc-2d28-4687-a424-05a1ebdfa3c3 in Status: SUCCESS [ 980.510119] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b10a43dc-2d28-4687-a424-05a1ebdfa3c3 deletion is rescheduled due to dependency. [ 980.510119] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b10a43dc-2d28-4687-a424-05a1ebdfa3c3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.705467] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b4dfff3d-ef74-48f2-8955-b975cccf84d9 in Status: SUCCESS [ 980.705467] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b4dfff3d-ef74-48f2-8955-b975cccf84d9 deletion is rescheduled due to dependency. [ 980.705467] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.010684] env[66502]: INFO networking_nsxv3.common.synchronization [None req-f7e646b0-e9d8-4e75-b13c-26ece6580e48 tempest-ServerDiskConfigTestJSON-940033598 tempest-ServerDiskConfigTestJSON-940033598-project-member] Enqueued Resource ID: 8cb4c05d-47aa-4373-bfb8-9f1e9078383a with Priority: HIGHEST for action security_group_rules [ 982.010958] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cb4c05d-47aa-4373-bfb8-9f1e9078383a with Priority: HIGHEST for action security_group_rules [ 982.011308] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8cb4c05d-47aa-4373-bfb8-9f1e9078383a taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.011453] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8cb4c05d-47aa-4373-bfb8-9f1e9078383a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.011502] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8cb4c05d-47aa-4373-bfb8-9f1e9078383a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.011778] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8cb4c05d-47aa-4373-bfb8-9f1e9078383a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.011859] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8cb4c05d-47aa-4373-bfb8-9f1e9078383a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.026365] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 38951171-ba5a-4a21-9804-7356a9fd37d5 in Status: SUCCESS [ 982.026888] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 38951171-ba5a-4a21-9804-7356a9fd37d5 deletion is rescheduled due to dependency. [ 982.026888] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-38951171-ba5a-4a21-9804-7356a9fd37d5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.148860] env[66502]: INFO networking_nsxv3.common.synchronization [None req-f1b595e6-dc79-439a-b08b-78e4b60aa0aa tempest-ServerDiskConfigTestJSON-940033598 tempest-ServerDiskConfigTestJSON-940033598-project-member] Enqueued Resource ID: 8cb4c05d-47aa-4373-bfb8-9f1e9078383a with Priority: HIGHEST for action security_group_rules [ 982.149721] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8cb4c05d-47aa-4373-bfb8-9f1e9078383a with Priority: HIGHEST for action security_group_rules [ 982.151922] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8cb4c05d-47aa-4373-bfb8-9f1e9078383a taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.151922] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8cb4c05d-47aa-4373-bfb8-9f1e9078383a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.266557] env[66502]: INFO networking_nsxv3.common.synchronization [req-8cca6ddd-2a54-47b3-8d8c-601186db6f0c req-c06bf356-cb15-4216-9a7c-7f52557420c4 tempest-ServersAdminTestJSON-292997046 tempest-ServersAdminTestJSON-292997046-project-member] Enqueued Resource ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 with Priority: HIGHEST for action security_group_members [ 982.267767] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 with Priority: HIGHEST for action security_group_members [ 982.267913] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.267983] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.270979] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.271715] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.271991] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.272662] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.272662] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.272868] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.273687] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.273813] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.542734] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.542734] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.542734] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.542734] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.543056] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.543091] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8cb4c05d-47aa-4373-bfb8-9f1e9078383a already deleted. [ 982.543224] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8cb4c05d-47aa-4373-bfb8-9f1e9078383a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.543460] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8cb4c05d-47aa-4373-bfb8-9f1e9078383a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.543806] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8cb4c05d-47aa-4373-bfb8-9f1e9078383a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.543859] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8cb4c05d-47aa-4373-bfb8-9f1e9078383a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 982.777873] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.069843] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.070330] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.070330] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.070330] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.070330] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.070568] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8cb4c05d-47aa-4373-bfb8-9f1e9078383a already deleted. [ 983.070568] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8cb4c05d-47aa-4373-bfb8-9f1e9078383a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.285162] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.788651] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.788901] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.789021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.789334] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.789436] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.789591] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 is going to be updated. [ 983.848605] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.848605] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.848605] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.848605] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.848605] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.869216] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 in Status: IN_PROGRESS for 2s [ 984.781131] env[66502]: INFO networking_nsxv3.common.synchronization [req-98b39e7b-ef1d-4aa7-8a88-ab26d80d915b req-405584c2-a99f-4386-99be-26489ad8c27e tempest-ImagesTestJSON-1088460097 tempest-ImagesTestJSON-1088460097-project-member] Enqueued Resource ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 with Priority: HIGHEST for action security_group_members [ 984.782042] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 with Priority: HIGHEST for action security_group_members [ 984.782376] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.782502] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.782575] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.782855] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.783295] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.783295] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.783295] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.783444] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.783444] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.783592] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.254886] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-545 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.255094] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-545" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.255220] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-545" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.255472] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-545" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.255781] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.255940] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.256068] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.256276] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.256418] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.256668] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 985.256782] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 985.256906] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 985.257021] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 985.257126] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 985.257229] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 985.257353] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 985.280524] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 985.280524] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 985.280524] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 985.280524] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-545" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.280524] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-2c062cf7-901f-4466-a578-fef507199c39 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.280998] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-2c062cf7-901f-4466-a578-fef507199c39" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.280998] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-2c062cf7-901f-4466-a578-fef507199c39" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.282019] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-2c062cf7-901f-4466-a578-fef507199c39" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.282019] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c062cf7-901f-4466-a578-fef507199c39',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.287103] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.287210] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.287265] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.287904] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.287904] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.287904] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.287904] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.288102] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.288141] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.288271] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.288312] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 is going to be updated. [ 985.316792] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.316921] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.316987] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.317206] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.317340] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.328676] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 in Status: IN_PROGRESS for 2s [ 985.497695] env[66502]: INFO networking_nsxv3.common.synchronization [req-ab2e4257-a0c4-4c9a-8eb6-caa70c92421f req-d9f35c07-d7d7-4414-9503-53ad77f00c4a tempest-ServerDiskConfigTestJSON-940033598 tempest-ServerDiskConfigTestJSON-940033598-project-member] Enqueued Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGHEST for action security_group_members [ 985.498271] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGHEST for action security_group_members [ 985.498714] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-aba51398-48dc-4f5e-b3cf-1da4130d58fb taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.499016] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.499016] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.499191] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.499354] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.499456] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.499522] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.499731] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.499840] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.499942] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.783853] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.784185] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.784321] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.784843] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.784975] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.785201] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 2c062cf7-901f-4466-a578-fef507199c39 not found, creating... [ 985.785579] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.785794] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.785943] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.786236] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.786434] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.786806] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.787028] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.787184] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.787429] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.787601] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.787769] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 2c062cf7-901f-4466-a578-fef507199c39 is going to be created. [ 985.816296] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.816296] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.816296] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.816296] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.816803] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.816803] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-2c062cf7-901f-4466-a578-fef507199c39" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.883772] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 in Status: SUCCESS [ 985.884012] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.001859] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.002550] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.002550] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.002550] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.030251] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.037381] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.039043] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.039043] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.039043] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.039043] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.039043] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb is going to be updated. [ 986.082388] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.082557] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.083201] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.083201] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.083201] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.095742] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb in Status: IN_PROGRESS for 2s [ 986.262098] env[66502]: INFO networking_nsxv3.common.synchronization [req-6cae1304-c521-460e-9a5d-25b015fc1952 req-e83aaa3b-7bdc-42e1-a521-2f2d8237e8d7 tempest-ServersNegativeTestJSON-1444377316 tempest-ServersNegativeTestJSON-1444377316-project-member] Enqueued Resource ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a with Priority: HIGHEST for action security_group_members [ 986.262098] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a with Priority: HIGHEST for action security_group_members [ 986.262098] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9ee12fee-49b0-4d1d-b52d-29888a355e8a taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.262098] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.262098] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.262363] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.262363] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.262434] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.262465] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.262724] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.262724] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.264915] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9ee12fee-49b0-4d1d-b52d-29888a355e8a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.608583] env[66502]: INFO networking_nsxv3.common.synchronization [req-98b39e7b-ef1d-4aa7-8a88-ab26d80d915b req-70c0a609-6101-42b3-9288-3f8a514cff86 service nova] Enqueued Resource ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 with Priority: HIGHEST for action security_group_rules [ 986.608762] env[66502]: INFO networking_nsxv3.common.synchronization [req-98b39e7b-ef1d-4aa7-8a88-ab26d80d915b req-70c0a609-6101-42b3-9288-3f8a514cff86 service nova] Enqueued Resource ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 with Priority: HIGHEST for action security_group_members [ 986.608896] env[66502]: INFO networking_nsxv3.common.synchronization [req-98b39e7b-ef1d-4aa7-8a88-ab26d80d915b req-70c0a609-6101-42b3-9288-3f8a514cff86 service nova] Enqueued Resource ID: 2c062cf7-901f-4466-a578-fef507199c39 with Priority: HIGHEST for action port [ 986.609493] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 with Priority: HIGHEST for action security_group_rules [ 986.609627] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 with Priority: HIGHEST for action security_group_members [ 986.609775] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c062cf7-901f-4466-a578-fef507199c39 with Priority: HIGHEST for action port [ 986.610103] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.610239] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.610239] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.610470] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.610546] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.615252] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.615252] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.615252] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c062cf7-901f-4466-a578-fef507199c39 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.615252] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c062cf7-901f-4466-a578-fef507199c39" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.615483] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c062cf7-901f-4466-a578-fef507199c39" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.615627] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c062cf7-901f-4466-a578-fef507199c39" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.619028] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c062cf7-901f-4466-a578-fef507199c39',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 986.765509] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.765621] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.765757] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.765936] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.766048] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.766273] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.766372] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.766608] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.766696] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.766733] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.766979] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a is going to be updated. [ 986.799799] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.800127] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.800127] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.800267] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.800424] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.812138] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a in Status: IN_PROGRESS for 2s [ 987.115790] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.115949] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.123782] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2c062cf7-901f-4466-a578-fef507199c39 with status ACTIVE [ 987.123782] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.123782] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.123782] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.123782] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.123782] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.123782] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.123782] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.123782] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.123782] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.123782] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.123782] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.123782] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.123782] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.123782] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.123782] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.123782] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2c062cf7-901f-4466-a578-fef507199c39 is going to be updated. [ 987.149528] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.149793] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.149793] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.150017] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.150249] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.150481] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c062cf7-901f-4466-a578-fef507199c39" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.342599] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 in Status: SUCCESS [ 987.342783] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 deletion is rescheduled due to dependency. [ 987.342944] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.343298] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.343514] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.343805] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 987.343988] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 987.344118] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 987.344456] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 987.344536] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 987.344750] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 987.849635] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.110231] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb in Status: SUCCESS [ 988.110231] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb deletion is rescheduled due to dependency. [ 988.110231] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.354057] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.827015] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a in Status: SUCCESS [ 988.827015] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a deletion is rescheduled due to dependency. [ 988.827015] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.859111] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.859529] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.859529] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.859708] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.859802] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.859915] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 is going to be updated. [ 988.895800] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.895800] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.896049] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.896140] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.896251] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.908058] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 in Status: IN_PROGRESS for 2s [ 990.920062] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 in Status: SUCCESS [ 990.920303] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.920358] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.920581] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.920765] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.920880] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.920944] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.921112] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.921192] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.921274] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.921364] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.394388] env[66502]: INFO networking_nsxv3.common.synchronization [req-f1048021-e38e-4cba-870d-5a29b4f5fb0f req-60a49465-5ba1-41d6-b965-2d5b5b746d47 tempest-AttachVolumeNegativeTest-686526601 tempest-AttachVolumeNegativeTest-686526601-project-member] Enqueued Resource ID: cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66 with Priority: HIGHEST for action security_group_members [ 991.394388] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66 with Priority: HIGHEST for action security_group_members [ 991.394388] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.395522] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.395632] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.395879] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.396066] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.396362] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.396362] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.396499] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.396587] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.396700] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.424234] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.424524] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.424524] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.425120] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.425120] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.425587] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.425587] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.425587] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.425724] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.425762] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.426345] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.426345] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.426345] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.426345] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.426345] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.427092] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.427092] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.427092] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.427092] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.427092] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.427092] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.640679] env[66502]: INFO networking_nsxv3.common.synchronization [None req-40ddbc3b-183b-457f-8457-5544d5b01fb4 None None] Enqueued Resource ID: 274afdf5-2378-43a6-b586-e0e92f7768c5 with Priority: HIGHEST for action port [ 991.641317] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 274afdf5-2378-43a6-b586-e0e92f7768c5 with Priority: HIGHEST for action port [ 991.641675] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-274afdf5-2378-43a6-b586-e0e92f7768c5 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.641812] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-274afdf5-2378-43a6-b586-e0e92f7768c5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.641877] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-274afdf5-2378-43a6-b586-e0e92f7768c5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.642192] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-274afdf5-2378-43a6-b586-e0e92f7768c5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.642314] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('274afdf5-2378-43a6-b586-e0e92f7768c5',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.786561] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-647 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.786910] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-647" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.786910] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-647" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.787770] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-647" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.788128] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.788470] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.788576] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.788836] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.789093] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.789440] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 991.789571] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 991.789705] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 991.789877] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 991.790152] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 991.791135] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 991.791384] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 991.812502] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 991.812671] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 991.812813] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 991.812979] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-647" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.813322] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-3e394e41-7b45-4089-896f-89e6f7c20752 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.813505] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-3e394e41-7b45-4089-896f-89e6f7c20752" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.813612] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-3e394e41-7b45-4089-896f-89e6f7c20752" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.813944] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-3e394e41-7b45-4089-896f-89e6f7c20752" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.814098] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e394e41-7b45-4089-896f-89e6f7c20752',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.899018] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.899288] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.899403] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.899643] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.899771] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.899983] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.900122] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.900161] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.900330] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.900405] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.900484] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66 already deleted. [ 991.900564] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.930760] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2: rpc.has_security_group_logging(os_id): False [ 991.950135] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.950458] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.950458] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.950566] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.950646] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.950833] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.950932] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.950992] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.951161] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.951236] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.951440] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.951535] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.951597] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.951737] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.951810] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.951993] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.954831] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.954831] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.954962] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.954962] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.955044] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 is going to be updated. [ 992.027467] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.027467] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.027467] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.027467] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.027467] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.037992] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 in Status: IN_PROGRESS for 2s [ 992.145538] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 274afdf5-2378-43a6-b586-e0e92f7768c5 [ 992.145729] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.145879] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.145971] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.146228] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.146334] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.146430] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:274afdf5-2378-43a6-b586-e0e92f7768c5 already deleted. [ 992.146515] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-274afdf5-2378-43a6-b586-e0e92f7768c5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.246647] env[66502]: INFO networking_nsxv3.common.synchronization [None req-1c5b8805-6cd5-4572-9fb0-5dc53cf1eee8 tempest-ServerRescueNegativeTestJSON-1777100369 tempest-ServerRescueNegativeTestJSON-1777100369-project-member] Enqueued Resource ID: 6768b7ab-f09a-42ec-87a9-9546009ee043 with Priority: HIGHEST for action security_group_rules [ 992.247259] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6768b7ab-f09a-42ec-87a9-9546009ee043 with Priority: HIGHEST for action security_group_rules [ 992.247484] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6768b7ab-f09a-42ec-87a9-9546009ee043 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.247700] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6768b7ab-f09a-42ec-87a9-9546009ee043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.247700] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6768b7ab-f09a-42ec-87a9-9546009ee043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.247932] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6768b7ab-f09a-42ec-87a9-9546009ee043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.248442] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6768b7ab-f09a-42ec-87a9-9546009ee043',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.317490] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.317490] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.317490] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.317490] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.317490] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.317490] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 3e394e41-7b45-4089-896f-89e6f7c20752 not found, creating... [ 992.318546] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.318546] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.318546] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.318546] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.318704] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.318930] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.319097] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.319229] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.320171] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.320950] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.320950] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 3e394e41-7b45-4089-896f-89e6f7c20752 is going to be created. [ 992.343694] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.343872] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.343996] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.344288] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.344605] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.344727] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-3e394e41-7b45-4089-896f-89e6f7c20752" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.456976] env[66502]: INFO networking_nsxv3.common.synchronization [None req-be5eab1a-0c0d-47b7-8ef3-3e44bd7b048e tempest-ServerRescueNegativeTestJSON-1777100369 tempest-ServerRescueNegativeTestJSON-1777100369-project-member] Enqueued Resource ID: 6768b7ab-f09a-42ec-87a9-9546009ee043 with Priority: HIGHEST for action security_group_rules [ 992.457545] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6768b7ab-f09a-42ec-87a9-9546009ee043 with Priority: HIGHEST for action security_group_rules [ 992.458966] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6768b7ab-f09a-42ec-87a9-9546009ee043 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.458966] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6768b7ab-f09a-42ec-87a9-9546009ee043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.561150] env[66502]: INFO networking_nsxv3.common.synchronization [None req-f7e5eed5-23b7-40a1-882a-eccd1148c623 tempest-AttachInterfacesTestJSON-1531294335 tempest-AttachInterfacesTestJSON-1531294335-project-member] Enqueued Resource ID: ee8e701d-05aa-43ae-8307-095303edba0f with Priority: HIGHEST for action security_group_rules [ 992.561810] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee8e701d-05aa-43ae-8307-095303edba0f with Priority: HIGHEST for action security_group_rules [ 992.562846] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee8e701d-05aa-43ae-8307-095303edba0f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.562981] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee8e701d-05aa-43ae-8307-095303edba0f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.563065] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee8e701d-05aa-43ae-8307-095303edba0f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.563384] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee8e701d-05aa-43ae-8307-095303edba0f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.563421] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee8e701d-05aa-43ae-8307-095303edba0f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.771409] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.772850] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.772850] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.772850] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.772850] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.772850] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6768b7ab-f09a-42ec-87a9-9546009ee043 already deleted. [ 992.772850] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6768b7ab-f09a-42ec-87a9-9546009ee043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.772850] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6768b7ab-f09a-42ec-87a9-9546009ee043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.773165] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6768b7ab-f09a-42ec-87a9-9546009ee043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.773202] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6768b7ab-f09a-42ec-87a9-9546009ee043',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.091648] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.091648] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.095263] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.095263] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.095263] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.095263] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee8e701d-05aa-43ae-8307-095303edba0f already deleted. [ 993.095263] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee8e701d-05aa-43ae-8307-095303edba0f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.133060] env[66502]: INFO networking_nsxv3.common.synchronization [req-f1048021-e38e-4cba-870d-5a29b4f5fb0f req-95f108e6-0e49-4d65-bda1-ea2ae9bfc137 service nova] Enqueued Resource ID: cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66 with Priority: HIGHEST for action security_group_rules [ 993.133310] env[66502]: INFO networking_nsxv3.common.synchronization [req-f1048021-e38e-4cba-870d-5a29b4f5fb0f req-95f108e6-0e49-4d65-bda1-ea2ae9bfc137 service nova] Enqueued Resource ID: cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66 with Priority: HIGHEST for action security_group_members [ 993.133505] env[66502]: INFO networking_nsxv3.common.synchronization [req-f1048021-e38e-4cba-870d-5a29b4f5fb0f req-95f108e6-0e49-4d65-bda1-ea2ae9bfc137 service nova] Enqueued Resource ID: 3e394e41-7b45-4089-896f-89e6f7c20752 with Priority: HIGHEST for action port [ 993.137025] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66 with Priority: HIGHEST for action security_group_rules [ 993.137025] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66 with Priority: HIGHEST for action security_group_members [ 993.137025] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3e394e41-7b45-4089-896f-89e6f7c20752 with Priority: HIGHEST for action port [ 993.137025] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.137025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.137025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.137025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.137025] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.138159] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.138332] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.138515] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.140263] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.142259] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.142259] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.142259] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.142259] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.142259] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.142259] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.142550] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-3e394e41-7b45-4089-896f-89e6f7c20752 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.142550] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3e394e41-7b45-4089-896f-89e6f7c20752" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.142550] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3e394e41-7b45-4089-896f-89e6f7c20752" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.142681] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3e394e41-7b45-4089-896f-89e6f7c20752" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.142714] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3e394e41-7b45-4089-896f-89e6f7c20752',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.262662] env[66502]: INFO networking_nsxv3.common.synchronization [None req-8b3991a3-aaeb-4f16-8883-d2165773700e tempest-AttachInterfacesTestJSON-1531294335 tempest-AttachInterfacesTestJSON-1531294335-project-member] Enqueued Resource ID: ee8e701d-05aa-43ae-8307-095303edba0f with Priority: HIGHEST for action security_group_rules [ 993.263357] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee8e701d-05aa-43ae-8307-095303edba0f with Priority: HIGHEST for action security_group_rules [ 993.263878] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee8e701d-05aa-43ae-8307-095303edba0f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.263878] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee8e701d-05aa-43ae-8307-095303edba0f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.263878] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee8e701d-05aa-43ae-8307-095303edba0f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.264280] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee8e701d-05aa-43ae-8307-095303edba0f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.264280] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee8e701d-05aa-43ae-8307-095303edba0f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.305234] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.305520] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.305520] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.305806] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.305918] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.306045] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6768b7ab-f09a-42ec-87a9-9546009ee043 already deleted. [ 993.306161] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6768b7ab-f09a-42ec-87a9-9546009ee043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.644762] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.646411] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.647404] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.647604] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3e394e41-7b45-4089-896f-89e6f7c20752 with status ACTIVE [ 993.647859] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.648521] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.648521] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.649173] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.651105] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.651105] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.651105] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.651105] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.651105] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.651105] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.651105] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.651105] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.651105] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.652330] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.652330] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.652330] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3e394e41-7b45-4089-896f-89e6f7c20752 is going to be updated. [ 993.693107] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.693306] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.693350] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.693525] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.693660] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.693811] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3e394e41-7b45-4089-896f-89e6f7c20752" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.805566] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.805698] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.805810] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.806087] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.806185] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.806286] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee8e701d-05aa-43ae-8307-095303edba0f already deleted. [ 993.806368] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee8e701d-05aa-43ae-8307-095303edba0f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.964105] env[66502]: INFO networking_nsxv3.common.synchronization [req-34d3942d-86bf-405f-8ac1-86fb8d9799dd req-a073a638-e560-417a-b727-4db648b7af6b tempest-ServersTestJSON-832869893 tempest-ServersTestJSON-832869893-project-member] Enqueued Resource ID: 14ec965c-75b2-4d76-849a-5e823fe2adcd with Priority: HIGHEST for action security_group_members [ 993.964105] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14ec965c-75b2-4d76-849a-5e823fe2adcd with Priority: HIGHEST for action security_group_members [ 993.964105] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-14ec965c-75b2-4d76-849a-5e823fe2adcd taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.964676] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14ec965c-75b2-4d76-849a-5e823fe2adcd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.964676] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14ec965c-75b2-4d76-849a-5e823fe2adcd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.964909] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14ec965c-75b2-4d76-849a-5e823fe2adcd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.964965] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.966120] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.966120] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.966120] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.966120] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.966120] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14ec965c-75b2-4d76-849a-5e823fe2adcd',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.053900] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 in Status: SUCCESS [ 994.054216] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.149497] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.412401] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-880 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.412547] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-880" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.412641] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-880" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.412959] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-880" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.413239] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.413405] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.413517] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.413817] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.413964] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.414361] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 994.414543] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 994.414689] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 994.414780] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 994.414896] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 994.414997] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 994.415154] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 994.436829] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 994.436990] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 994.437144] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 994.437317] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-880" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.437790] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-76b2a1d5-1352-4b32-8f25-c8f8e1a4d37a taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.438017] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-76b2a1d5-1352-4b32-8f25-c8f8e1a4d37a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.438411] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-76b2a1d5-1352-4b32-8f25-c8f8e1a4d37a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.439057] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-76b2a1d5-1352-4b32-8f25-c8f8e1a4d37a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.439057] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76b2a1d5-1352-4b32-8f25-c8f8e1a4d37a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.470622] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.470622] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.473777] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.473777] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.473777] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.473777] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.473777] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.473777] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.473777] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.473777] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.473777] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14ec965c-75b2-4d76-849a-5e823fe2adcd already deleted. [ 994.473777] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14ec965c-75b2-4d76-849a-5e823fe2adcd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.544445] env[66502]: INFO networking_nsxv3.common.synchronization [None req-9370c056-5ec4-477f-9ef7-cbc21e0697fd None None] Enqueued Resource ID: e1d43dd1-bae0-49aa-87c3-4aec11979863 with Priority: HIGHEST for action port [ 994.544972] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e1d43dd1-bae0-49aa-87c3-4aec11979863 with Priority: HIGHEST for action port [ 994.548166] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-e1d43dd1-bae0-49aa-87c3-4aec11979863 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.548314] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e1d43dd1-bae0-49aa-87c3-4aec11979863" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.548639] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e1d43dd1-bae0-49aa-87c3-4aec11979863" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.548774] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e1d43dd1-bae0-49aa-87c3-4aec11979863" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.548774] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e1d43dd1-bae0-49aa-87c3-4aec11979863',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.654218] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.654218] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.654218] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.654218] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.654218] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.654218] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66 is going to be created. [ 994.678530] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.678768] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.678768] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.678949] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.679196] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.690174] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66 in Status: UNINITIALIZED for 2s [ 994.942221] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.942221] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.942221] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.942221] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.942221] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.942221] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port 76b2a1d5-1352-4b32-8f25-c8f8e1a4d37a not found, creating... [ 994.942483] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.942483] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.942565] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.942958] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.942958] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.943198] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.943326] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.943439] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.943649] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.943848] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.943999] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: 76b2a1d5-1352-4b32-8f25-c8f8e1a4d37a is going to be created. [ 994.966911] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.966911] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.966911] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.966911] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.966911] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.966911] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-76b2a1d5-1352-4b32-8f25-c8f8e1a4d37a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.051487] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e1d43dd1-bae0-49aa-87c3-4aec11979863 [ 995.052927] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.052927] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.052927] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.052927] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.052927] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.052927] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e1d43dd1-bae0-49aa-87c3-4aec11979863 already deleted. [ 995.052927] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e1d43dd1-bae0-49aa-87c3-4aec11979863" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.710327] env[66502]: INFO networking_nsxv3.common.synchronization [req-34d3942d-86bf-405f-8ac1-86fb8d9799dd req-0c166ddf-5185-4300-a5b0-bb9ba3921a31 service nova] Enqueued Resource ID: 14ec965c-75b2-4d76-849a-5e823fe2adcd with Priority: HIGHEST for action security_group_rules [ 995.710327] env[66502]: INFO networking_nsxv3.common.synchronization [req-34d3942d-86bf-405f-8ac1-86fb8d9799dd req-0c166ddf-5185-4300-a5b0-bb9ba3921a31 service nova] Enqueued Resource ID: 14ec965c-75b2-4d76-849a-5e823fe2adcd with Priority: HIGHEST for action security_group_members [ 995.710327] env[66502]: INFO networking_nsxv3.common.synchronization [req-34d3942d-86bf-405f-8ac1-86fb8d9799dd req-0c166ddf-5185-4300-a5b0-bb9ba3921a31 service nova] Enqueued Resource ID: 76b2a1d5-1352-4b32-8f25-c8f8e1a4d37a with Priority: HIGHEST for action port [ 995.710646] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14ec965c-75b2-4d76-849a-5e823fe2adcd with Priority: HIGHEST for action security_group_rules [ 995.710807] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14ec965c-75b2-4d76-849a-5e823fe2adcd with Priority: HIGHEST for action security_group_members [ 995.711121] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76b2a1d5-1352-4b32-8f25-c8f8e1a4d37a with Priority: HIGHEST for action port [ 995.711321] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14ec965c-75b2-4d76-849a-5e823fe2adcd taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.711321] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14ec965c-75b2-4d76-849a-5e823fe2adcd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.711401] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14ec965c-75b2-4d76-849a-5e823fe2adcd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.711594] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14ec965c-75b2-4d76-849a-5e823fe2adcd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.711680] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14ec965c-75b2-4d76-849a-5e823fe2adcd',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.712560] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-14ec965c-75b2-4d76-849a-5e823fe2adcd taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.713023] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14ec965c-75b2-4d76-849a-5e823fe2adcd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.713111] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14ec965c-75b2-4d76-849a-5e823fe2adcd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.713327] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14ec965c-75b2-4d76-849a-5e823fe2adcd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.713435] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.713539] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.713600] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.713750] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.713852] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.713947] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14ec965c-75b2-4d76-849a-5e823fe2adcd',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 995.714975] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-76b2a1d5-1352-4b32-8f25-c8f8e1a4d37a taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.714975] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-76b2a1d5-1352-4b32-8f25-c8f8e1a4d37a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.714975] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-76b2a1d5-1352-4b32-8f25-c8f8e1a4d37a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.715144] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-76b2a1d5-1352-4b32-8f25-c8f8e1a4d37a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.715144] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76b2a1d5-1352-4b32-8f25-c8f8e1a4d37a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.216865] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('14ec965c-75b2-4d76-849a-5e823fe2adcd',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.217991] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-14ec965c-75b2-4d76-849a-5e823fe2adcd taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.218105] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14ec965c-75b2-4d76-849a-5e823fe2adcd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.218254] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 76b2a1d5-1352-4b32-8f25-c8f8e1a4d37a with status ACTIVE [ 996.218418] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.218511] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.218570] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.218781] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.218903] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.219204] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.219342] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.219395] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.223023] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.223023] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.223023] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.223023] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.223023] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.223023] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.223023] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.223023] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 76b2a1d5-1352-4b32-8f25-c8f8e1a4d37a is going to be updated. [ 996.244875] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.245043] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.245115] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.245350] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.245471] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.245628] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-76b2a1d5-1352-4b32-8f25-c8f8e1a4d37a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.436728] env[66502]: INFO networking_nsxv3.common.synchronization [req-a0263089-04cf-4229-b06d-b339af628a6c req-af516096-7b4c-4683-b98d-a39805160be9 tempest-InstanceActionsNegativeTestJSON-473187982 tempest-InstanceActionsNegativeTestJSON-473187982-project-member] Enqueued Resource ID: 4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f with Priority: HIGHEST for action security_group_members [ 996.439701] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f with Priority: HIGHEST for action security_group_members [ 996.440702] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.440944] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.442147] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.442147] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.442147] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.442147] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.442147] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.442147] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.442147] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.442147] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.700444] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66 in Status: SUCCESS [ 996.700547] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.700914] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.701187] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.701422] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.701569] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.701654] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.701843] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.701934] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.702033] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.702127] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.722671] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('14ec965c-75b2-4d76-849a-5e823fe2adcd',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.760217] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-486 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.760495] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-486" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.760654] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-486" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.761128] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-486" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.761276] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.761467] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.761583] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.761825] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.762011] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.762234] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 996.762349] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 996.762459] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 996.762564] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 996.762672] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 996.762772] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 996.762902] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 996.781704] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 996.781876] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 996.782016] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 996.782190] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-486" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.782496] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-6eed6a16-4502-4bf9-928a-60a18563da4c taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.782671] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-6eed6a16-4502-4bf9-928a-60a18563da4c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.782809] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-6eed6a16-4502-4bf9-928a-60a18563da4c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.783128] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-6eed6a16-4502-4bf9-928a-60a18563da4c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.783264] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6eed6a16-4502-4bf9-928a-60a18563da4c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.944065] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.944236] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.944323] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.944528] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.944633] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.944825] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.944919] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.944978] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.945155] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.945204] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.945291] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f already deleted. [ 996.945402] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.204220] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 997.225197] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.225395] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.225506] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.225782] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.225902] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.226055] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14ec965c-75b2-4d76-849a-5e823fe2adcd is going to be created. [ 997.252896] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.253056] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.253130] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.253347] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.253503] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.265193] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14ec965c-75b2-4d76-849a-5e823fe2adcd in Status: UNINITIALIZED for 2s [ 997.285788] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.286129] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.286186] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.286484] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.286859] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.287051] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port 6eed6a16-4502-4bf9-928a-60a18563da4c not found, creating... [ 997.287330] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.287491] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.287619] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.288018] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.288329] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.288757] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.288939] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.290652] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.290932] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.291120] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.291277] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: 6eed6a16-4502-4bf9-928a-60a18563da4c is going to be created. [ 997.317095] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.317352] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.317899] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.317899] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.318120] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.318307] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-6eed6a16-4502-4bf9-928a-60a18563da4c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.707031] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66: rpc.has_security_group_logging(os_id): False [ 997.725667] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.726087] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.726087] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.726167] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.726230] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.726466] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.726627] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.726741] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.726850] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.726925] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.727046] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66 is going to be created. [ 997.787229] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.787497] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.787497] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.787696] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.787898] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 997.806475] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66 in Status: IN_PROGRESS for 2s [ 998.061198] env[66502]: INFO networking_nsxv3.common.synchronization [req-a0263089-04cf-4229-b06d-b339af628a6c req-e8e870cb-037e-46ad-a513-a33c19f53cfb service nova] Enqueued Resource ID: 4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f with Priority: HIGHEST for action security_group_rules [ 998.061436] env[66502]: INFO networking_nsxv3.common.synchronization [req-a0263089-04cf-4229-b06d-b339af628a6c req-e8e870cb-037e-46ad-a513-a33c19f53cfb service nova] Enqueued Resource ID: 4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f with Priority: HIGHEST for action security_group_members [ 998.061603] env[66502]: INFO networking_nsxv3.common.synchronization [req-a0263089-04cf-4229-b06d-b339af628a6c req-e8e870cb-037e-46ad-a513-a33c19f53cfb service nova] Enqueued Resource ID: 6eed6a16-4502-4bf9-928a-60a18563da4c with Priority: HIGHEST for action port [ 998.062831] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f with Priority: HIGHEST for action security_group_rules [ 998.062831] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f with Priority: HIGHEST for action security_group_members [ 998.062831] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6eed6a16-4502-4bf9-928a-60a18563da4c with Priority: HIGHEST for action port [ 998.063050] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.063050] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.063265] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.063512] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.063589] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.064506] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.064636] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.064719] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.065089] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.065089] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.065244] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.065244] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.065388] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.065388] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.065475] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.067065] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-6eed6a16-4502-4bf9-928a-60a18563da4c taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.067065] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6eed6a16-4502-4bf9-928a-60a18563da4c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.067065] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6eed6a16-4502-4bf9-928a-60a18563da4c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.067065] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6eed6a16-4502-4bf9-928a-60a18563da4c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.067065] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6eed6a16-4502-4bf9-928a-60a18563da4c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.569318] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.569464] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.569767] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.570999] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6eed6a16-4502-4bf9-928a-60a18563da4c with status ACTIVE [ 998.571153] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.571270] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.571385] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.571637] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.571784] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.571914] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.572028] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.572093] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.572250] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.572330] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.572506] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.572599] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.572659] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.572828] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.572903] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.572990] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6eed6a16-4502-4bf9-928a-60a18563da4c is going to be updated. [ 998.599220] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.599220] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.599220] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.599522] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.599522] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.599747] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6eed6a16-4502-4bf9-928a-60a18563da4c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.895732] env[66502]: INFO networking_nsxv3.common.synchronization [req-7560bf4e-b45b-428d-9648-8afa7faa7c13 req-96eb7d2e-0b31-41c8-b257-725d7b66bca7 tempest-DeleteServersTestJSON-51385704 tempest-DeleteServersTestJSON-51385704-project-member] Enqueued Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_members [ 998.896273] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_members [ 998.896619] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-704e5eab-aa44-4493-8c9a-0b24250e7bea taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.896750] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.896812] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.897026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.897216] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.897311] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.897378] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.897513] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.897598] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.897674] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.074831] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.252273] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-608 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.252463] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-608" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.252587] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-608" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.252884] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-608" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.253151] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.253307] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.253418] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.253630] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.253772] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.253969] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 999.254115] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 999.254225] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 999.254328] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 999.254434] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 999.254536] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 999.254662] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 999.278928] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14ec965c-75b2-4d76-849a-5e823fe2adcd in Status: SUCCESS [ 999.279194] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14ec965c-75b2-4d76-849a-5e823fe2adcd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.279346] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14ec965c-75b2-4d76-849a-5e823fe2adcd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.279556] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14ec965c-75b2-4d76-849a-5e823fe2adcd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.279742] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.279855] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.279917] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.280075] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.280154] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.280243] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14ec965c-75b2-4d76-849a-5e823fe2adcd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.280319] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('14ec965c-75b2-4d76-849a-5e823fe2adcd',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.285378] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 999.286041] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 999.286041] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 999.286041] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-608" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.286228] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-626b695b-f37a-4768-aa04-9a11bb2572be taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.286346] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-626b695b-f37a-4768-aa04-9a11bb2572be" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.286460] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-626b695b-f37a-4768-aa04-9a11bb2572be" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.286865] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-626b695b-f37a-4768-aa04-9a11bb2572be" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.286999] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('626b695b-f37a-4768-aa04-9a11bb2572be',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.402676] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.402676] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.402676] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.402676] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.402676] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.402676] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.402676] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.402676] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.402676] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.402676] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.402676] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea is going to be updated. [ 999.437045] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.437045] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.437045] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.437045] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.438603] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.450152] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: IN_PROGRESS for 2s [ 999.578301] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.578301] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.578434] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.578560] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.578654] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.578749] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f is going to be created. [ 999.608730] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.608925] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.609028] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.609290] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.609614] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.620327] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f in Status: UNINITIALIZED for 2s [ 999.782553] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('14ec965c-75b2-4d76-849a-5e823fe2adcd',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.789452] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.789646] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.789748] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.790048] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.790205] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.790360] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 626b695b-f37a-4768-aa04-9a11bb2572be not found, creating... [ 999.790621] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.790782] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.790898] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.791178] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.791323] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.791607] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.791776] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.791892] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.792120] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.792258] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.792412] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 626b695b-f37a-4768-aa04-9a11bb2572be is going to be created. [ 999.818804] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.818804] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.819427] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.819427] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.819427] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.819740] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-626b695b-f37a-4768-aa04-9a11bb2572be" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.821266] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66 in Status: SUCCESS [ 999.821488] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.286085] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 14ec965c-75b2-4d76-849a-5e823fe2adcd: rpc.has_security_group_logging(os_id): False [ 1000.317064] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.317291] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.317291] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.317654] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.317654] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.317943] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.318087] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.318171] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.318338] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.318416] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.318508] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14ec965c-75b2-4d76-849a-5e823fe2adcd is going to be created. [ 1000.396766] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.397059] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.397059] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.397245] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.397427] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.410168] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14ec965c-75b2-4d76-849a-5e823fe2adcd in Status: IN_PROGRESS for 2s [ 1000.548325] env[66502]: INFO networking_nsxv3.common.synchronization [req-7560bf4e-b45b-428d-9648-8afa7faa7c13 req-454f1425-7f22-4bbe-8462-b829b89bca3b service nova] Enqueued Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_rules [ 1000.548510] env[66502]: INFO networking_nsxv3.common.synchronization [req-7560bf4e-b45b-428d-9648-8afa7faa7c13 req-454f1425-7f22-4bbe-8462-b829b89bca3b service nova] Enqueued Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_members [ 1000.548646] env[66502]: INFO networking_nsxv3.common.synchronization [req-7560bf4e-b45b-428d-9648-8afa7faa7c13 req-454f1425-7f22-4bbe-8462-b829b89bca3b service nova] Enqueued Resource ID: 626b695b-f37a-4768-aa04-9a11bb2572be with Priority: HIGHEST for action port [ 1000.549275] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_rules [ 1000.549413] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_members [ 1000.549958] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 626b695b-f37a-4768-aa04-9a11bb2572be with Priority: HIGHEST for action port [ 1000.549958] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-704e5eab-aa44-4493-8c9a-0b24250e7bea taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.549958] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.549958] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.550274] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.550319] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.551215] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-704e5eab-aa44-4493-8c9a-0b24250e7bea taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.551316] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.552297] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-626b695b-f37a-4768-aa04-9a11bb2572be taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.552297] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-626b695b-f37a-4768-aa04-9a11bb2572be" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.552297] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-626b695b-f37a-4768-aa04-9a11bb2572be" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.552297] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-626b695b-f37a-4768-aa04-9a11bb2572be" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.552297] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('626b695b-f37a-4768-aa04-9a11bb2572be',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.053962] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-704e5eab-aa44-4493-8c9a-0b24250e7bea taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.054132] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.055417] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 626b695b-f37a-4768-aa04-9a11bb2572be with status ACTIVE [ 1001.058997] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.058997] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.058997] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.058997] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.058997] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.058997] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.058997] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.058997] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.058997] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.058997] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.058997] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.058997] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.058997] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.058997] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.058997] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.058997] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 626b695b-f37a-4768-aa04-9a11bb2572be is going to be updated. [ 1001.081375] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.081522] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.081608] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.081842] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.081991] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.082172] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-626b695b-f37a-4768-aa04-9a11bb2572be" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.461289] env[66502]: INFO networking_nsxv3.common.synchronization [req-b6913916-da26-421f-b35b-de71ef1223a8 req-419216da-2fbe-475a-8d82-5606cb2474e7 tempest-ServersTestJSON-1210226259 tempest-ServersTestJSON-1210226259-project-member] Enqueued Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_members [ 1001.462364] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: SUCCESS [ 1001.462530] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea deletion is rescheduled due to dependency. [ 1001.462640] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.463144] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_members [ 1001.463314] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.463584] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.463696] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.463805] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.463869] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.464037] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.464122] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.464215] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.465662] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.465865] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.465938] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.466285] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.466285] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.466402] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.466402] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.466653] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.466653] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.466753] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.632716] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f in Status: SUCCESS [ 1001.632889] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.633652] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.633652] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.633652] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.633652] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.633652] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.633997] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.633997] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.633997] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.634123] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.816392] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-708 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.816392] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-708" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.816392] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-708" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.816392] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-708" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.816790] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.816949] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.817107] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.817361] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.817517] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.817784] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1001.817907] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1001.818027] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1001.818138] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1001.818250] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1001.818356] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1001.818489] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1001.838061] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1001.838254] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1001.838304] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1001.838512] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-708" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.838807] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-645de22a-6515-45ae-b8b6-fed2be8f9648 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.839146] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-645de22a-6515-45ae-b8b6-fed2be8f9648" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.839146] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-645de22a-6515-45ae-b8b6-fed2be8f9648" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.839446] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-645de22a-6515-45ae-b8b6-fed2be8f9648" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.839589] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('645de22a-6515-45ae-b8b6-fed2be8f9648',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.966473] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.971500] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.139788] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.140539] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.140539] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.140539] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.140539] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.140757] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.140757] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.140907] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.140990] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.141068] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.141302] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.141437] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.141505] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.141679] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.142132] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.142132] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.142132] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.142400] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.142400] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.142478] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.142586] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.344088] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.344088] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.344088] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.344088] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.344088] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.344088] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port 645de22a-6515-45ae-b8b6-fed2be8f9648 not found, creating... [ 1002.344586] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.344738] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.344931] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.345876] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.345876] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.346113] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.346366] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.346558] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.346933] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.350018] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.350018] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: 645de22a-6515-45ae-b8b6-fed2be8f9648 is going to be created. [ 1002.373952] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.374246] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.374375] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.374817] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.375062] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.375307] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-645de22a-6515-45ae-b8b6-fed2be8f9648" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.434652] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14ec965c-75b2-4d76-849a-5e823fe2adcd in Status: SUCCESS [ 1002.434926] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14ec965c-75b2-4d76-849a-5e823fe2adcd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.469620] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.474072] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.644984] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f: rpc.has_security_group_logging(os_id): False [ 1002.669697] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.669905] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.669905] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.670157] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.670249] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.670475] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.670582] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.670649] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.670819] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.670936] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.671245] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.671355] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.671433] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.671626] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.671730] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.671930] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.672093] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.672182] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.672352] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.672467] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.672609] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f is going to be created. [ 1002.744246] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.744507] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.744582] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.744797] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.745076] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.757533] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f in Status: IN_PROGRESS for 2s [ 1002.973238] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.973407] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.974098] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.974098] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.974098] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.974098] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea is going to be updated. [ 1002.976061] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.976213] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.976284] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.976496] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.976645] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.976783] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d226a97-2d69-4706-b98b-565700008c6f is going to be updated. [ 1003.008266] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.008537] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.008586] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.008920] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.009118] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.012605] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.012741] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.013187] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.013187] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.013361] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.027216] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: IN_PROGRESS for 2s [ 1003.028107] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: IN_PROGRESS for 2s [ 1003.159063] env[66502]: INFO networking_nsxv3.common.synchronization [req-b6913916-da26-421f-b35b-de71ef1223a8 req-60fcec03-7568-4f39-8b83-c7451aecc2f0 service nova] Enqueued Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_rules [ 1003.159442] env[66502]: INFO networking_nsxv3.common.synchronization [req-b6913916-da26-421f-b35b-de71ef1223a8 req-60fcec03-7568-4f39-8b83-c7451aecc2f0 service nova] Enqueued Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_members [ 1003.159619] env[66502]: INFO networking_nsxv3.common.synchronization [req-b6913916-da26-421f-b35b-de71ef1223a8 req-60fcec03-7568-4f39-8b83-c7451aecc2f0 service nova] Enqueued Resource ID: 645de22a-6515-45ae-b8b6-fed2be8f9648 with Priority: HIGHEST for action port [ 1003.161768] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_rules [ 1003.161768] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_members [ 1003.161768] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 645de22a-6515-45ae-b8b6-fed2be8f9648 with Priority: HIGHEST for action port [ 1003.162037] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.162139] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.162192] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.162576] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.162699] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.163845] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.163845] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.163996] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-645de22a-6515-45ae-b8b6-fed2be8f9648 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.164109] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-645de22a-6515-45ae-b8b6-fed2be8f9648" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.164161] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-645de22a-6515-45ae-b8b6-fed2be8f9648" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.166342] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-645de22a-6515-45ae-b8b6-fed2be8f9648" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.166342] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('645de22a-6515-45ae-b8b6-fed2be8f9648',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.667080] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.667404] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.667404] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 645de22a-6515-45ae-b8b6-fed2be8f9648 with status ACTIVE [ 1003.667560] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.667695] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.667818] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.668010] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.668104] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.668274] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.668363] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.668427] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.668588] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.668664] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.672412] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.672412] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.672412] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.672553] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.672853] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.672853] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 645de22a-6515-45ae-b8b6-fed2be8f9648 is going to be updated. [ 1003.699561] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.699719] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.699821] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.700183] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.700406] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.700682] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-645de22a-6515-45ae-b8b6-fed2be8f9648" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.771270] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f in Status: SUCCESS [ 1004.771704] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.044294] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: SUCCESS [ 1005.044814] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.045517] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: SUCCESS [ 1005.045773] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.045983] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.046249] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.046493] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.046653] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.046767] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.049286] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.049286] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.049569] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.049651] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.050702] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.050987] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.051224] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.051342] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.051409] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.051570] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.051652] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.051745] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.560890] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.563683] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-704e5eab-aa44-4493-8c9a-0b24250e7bea taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.563842] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.563912] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.564163] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.564335] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.564439] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.564501] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.564678] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.564768] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.564854] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.565014] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-704e5eab-aa44-4493-8c9a-0b24250e7bea taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.565116] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.565177] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.567971] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.567971] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.567971] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.567971] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.567971] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.567971] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.567971] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.567971] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.065071] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.069654] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 704e5eab-aa44-4493-8c9a-0b24250e7bea: rpc.has_security_group_logging(os_id): False [ 1006.091186] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.091186] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.091186] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.091186] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.091186] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.091186] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.091186] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.091186] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.091186] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.091186] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.091921] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.091921] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.091921] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.091921] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.091921] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.091921] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.092140] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.093021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.093021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.093021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.093021] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea is going to be updated. [ 1006.185446] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.185593] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.185661] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.186319] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.186319] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.212122] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: IN_PROGRESS for 2s [ 1006.567296] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.567473] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.567473] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.567730] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.567823] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.567956] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d226a97-2d69-4706-b98b-565700008c6f is going to be updated. [ 1006.599914] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.600110] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.600169] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.600413] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.600687] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.611774] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: IN_PROGRESS for 2s [ 1008.162942] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1008.163379] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 1008.176074] env[66502]: INFO networking_nsxv3.common.synchronization [None req-22f916d9-8421-4b28-bf8d-c360d13be5f2 None None] Enqueued Resource ID: e8c42b19-898a-47dc-ab7f-70d5d6ea9d4c with Priority: HIGHEST for action port [ 1008.176074] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e8c42b19-898a-47dc-ab7f-70d5d6ea9d4c with Priority: HIGHEST for action port [ 1008.176074] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-e8c42b19-898a-47dc-ab7f-70d5d6ea9d4c taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.176074] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e8c42b19-898a-47dc-ab7f-70d5d6ea9d4c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.176074] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e8c42b19-898a-47dc-ab7f-70d5d6ea9d4c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.176074] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e8c42b19-898a-47dc-ab7f-70d5d6ea9d4c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.176074] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e8c42b19-898a-47dc-ab7f-70d5d6ea9d4c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.226686] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: SUCCESS [ 1008.226939] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.628475] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: SUCCESS [ 1008.628779] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.628983] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.629692] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.632615] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.632615] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.632615] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.632615] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.632615] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.632615] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.632615] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.679044] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e8c42b19-898a-47dc-ab7f-70d5d6ea9d4c [ 1008.679044] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.679044] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.679044] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.679347] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.679467] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.679619] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e8c42b19-898a-47dc-ab7f-70d5d6ea9d4c already deleted. [ 1008.679898] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e8c42b19-898a-47dc-ab7f-70d5d6ea9d4c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.771107] env[66502]: INFO networking_nsxv3.common.synchronization [req-0fad7365-11aa-4bcd-a0fb-a48647b80af7 req-5add380d-4234-48f7-b38f-ff9716e31112 tempest-ImagesTestJSON-1088460097 tempest-ImagesTestJSON-1088460097-project-member] Enqueued Resource ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 with Priority: HIGHEST for action security_group_members [ 1008.771662] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 with Priority: HIGHEST for action security_group_members [ 1008.773175] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.773322] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.773399] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.773606] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.774675] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.774796] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.774872] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.775064] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.775178] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.775276] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6de9830d-7ae4-42f4-8f89-7bd0093a3ef2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.041806] env[66502]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1009.042061] env[66502]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] NSXv3 Agent Agent loop - iteration:2 started [ 1009.135017] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.135274] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.135383] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.135718] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.135974] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.136146] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.136245] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.136482] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.136619] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.136762] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.137427] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.137427] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.137427] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.137606] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.137746] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.137910] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.138024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.138273] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.138409] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.138513] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.138680] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.281353] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.281353] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.281353] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.281353] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.281353] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.281353] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.281353] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.281353] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.281353] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.281353] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.281353] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 is going to be updated. [ 1009.332935] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.333320] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.333641] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.334049] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.334349] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.347158] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 in Status: IN_PROGRESS for 2s [ 1009.641523] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9d226a97-2d69-4706-b98b-565700008c6f: rpc.has_security_group_logging(os_id): False [ 1009.660974] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.661215] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.661215] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.661437] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.661530] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.661921] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.662075] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.662141] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.662303] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.662383] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.662588] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.662680] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.662742] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.662878] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.662952] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.664223] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.664223] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.664476] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.664663] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.664742] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.664831] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d226a97-2d69-4706-b98b-565700008c6f is going to be updated. [ 1009.732032] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.732225] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.732315] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.732589] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.732793] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.757232] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: IN_PROGRESS for 2s [ 1010.586551] env[66502]: INFO networking_nsxv3.common.synchronization [None req-3ea805da-12d0-4491-a21e-493585ba57a7 None None] Enqueued Resource ID: d1ea01c3-b4cb-43e4-a181-83791c7b9d84 with Priority: HIGHEST for action port [ 1010.587763] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d1ea01c3-b4cb-43e4-a181-83791c7b9d84 with Priority: HIGHEST for action port [ 1010.588904] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-d1ea01c3-b4cb-43e4-a181-83791c7b9d84 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.589077] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d1ea01c3-b4cb-43e4-a181-83791c7b9d84" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.589144] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d1ea01c3-b4cb-43e4-a181-83791c7b9d84" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.589463] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d1ea01c3-b4cb-43e4-a181-83791c7b9d84" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.589659] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d1ea01c3-b4cb-43e4-a181-83791c7b9d84',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.092616] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d1ea01c3-b4cb-43e4-a181-83791c7b9d84 [ 1011.092839] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.092971] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.093055] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.093282] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.093372] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.093469] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d1ea01c3-b4cb-43e4-a181-83791c7b9d84 already deleted. [ 1011.093578] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d1ea01c3-b4cb-43e4-a181-83791c7b9d84" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.358776] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 in Status: SUCCESS [ 1011.359044] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6de9830d-7ae4-42f4-8f89-7bd0093a3ef2 deletion is rescheduled due to dependency. [ 1011.359212] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6de9830d-7ae4-42f4-8f89-7bd0093a3ef2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.614759] env[66502]: INFO networking_nsxv3.common.synchronization [None req-82da3e06-a79d-4bfb-ab65-aef681dfe686 None None] Enqueued Resource ID: 85f3d5a3-c285-412c-997e-c2267df2c518 with Priority: HIGHEST for action port [ 1011.615406] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85f3d5a3-c285-412c-997e-c2267df2c518 with Priority: HIGHEST for action port [ 1011.615623] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-85f3d5a3-c285-412c-997e-c2267df2c518 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.616649] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85f3d5a3-c285-412c-997e-c2267df2c518" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.616649] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85f3d5a3-c285-412c-997e-c2267df2c518" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.616649] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85f3d5a3-c285-412c-997e-c2267df2c518" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.617162] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85f3d5a3-c285-412c-997e-c2267df2c518',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.707917] env[66502]: INFO networking_nsxv3.common.synchronization [req-993d064c-3d1c-4c30-b34d-ae92f1882b92 req-9c8678f5-6ba4-4d13-b73d-52912b5f0365 tempest-ServersAdminTestJSON-292997046 tempest-ServersAdminTestJSON-292997046-project-member] Enqueued Resource ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 with Priority: HIGHEST for action security_group_members [ 1011.708816] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 with Priority: HIGHEST for action security_group_members [ 1011.709267] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.709379] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.710031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.710258] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.710427] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.711523] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.711523] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.711523] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.711523] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.711523] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.769674] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: SUCCESS [ 1011.769983] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.034839] env[66502]: INFO networking_nsxv3.common.synchronization [req-0d11100d-82db-4981-850c-84bbcf412995 req-0d4f0bd2-986e-4cac-b834-f903c818a549 tempest-ServerDiskConfigTestJSON-940033598 tempest-ServerDiskConfigTestJSON-940033598-project-member] Enqueued Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGHEST for action security_group_members [ 1012.035610] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGHEST for action security_group_members [ 1012.036012] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-aba51398-48dc-4f5e-b3cf-1da4130d58fb taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.036140] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.036271] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.036507] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.036717] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.036843] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.036950] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.037137] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.037224] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.037341] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.119503] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 85f3d5a3-c285-412c-997e-c2267df2c518 [ 1012.119707] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.119844] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.119912] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.120141] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.120233] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.120451] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:85f3d5a3-c285-412c-997e-c2267df2c518 already deleted. [ 1012.120506] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85f3d5a3-c285-412c-997e-c2267df2c518" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.210313] env[66502]: INFO networking_nsxv3.common.synchronization [None req-8ea7db0d-0117-4e1e-bedc-b5c6f915a24c tempest-AttachVolumeShelveTestJSON-163785099 tempest-AttachVolumeShelveTestJSON-163785099-project-member] Enqueued Resource ID: 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 with Priority: HIGHEST for action security_group_rules [ 1012.210884] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 with Priority: HIGHEST for action security_group_rules [ 1012.211202] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.211321] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.211381] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.211637] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.213035] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14691ab9-6ef7-4499-a5c8-0c1a0b5a8191',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.213035] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.227418] env[66502]: INFO networking_nsxv3.common.synchronization [req-1a135624-bd13-46c0-9537-259d0fbf9323 req-3687b9f5-e7cd-4d0c-ad3b-802de6a0f6ab tempest-InstanceActionsNegativeTestJSON-473187982 tempest-InstanceActionsNegativeTestJSON-473187982-project-member] Enqueued Resource ID: 4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f with Priority: HIGHEST for action security_group_members [ 1012.228114] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f with Priority: HIGHEST for action security_group_members [ 1012.228627] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.228627] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.228851] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.229166] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.229242] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.229760] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.229760] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.229760] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.229760] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.230012] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.371358] env[66502]: INFO networking_nsxv3.common.synchronization [None req-b5922a23-6e01-4aeb-9551-facc29e0d64e tempest-AttachVolumeShelveTestJSON-163785099 tempest-AttachVolumeShelveTestJSON-163785099-project-member] Enqueued Resource ID: 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 with Priority: HIGHEST for action security_group_rules [ 1012.371999] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 with Priority: HIGHEST for action security_group_rules [ 1012.371999] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.372166] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.545303] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.545303] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.545303] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.545303] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.545303] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.545303] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.545303] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.545303] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.545303] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.546309] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.546309] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb is going to be updated. [ 1012.552720] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-509 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.552720] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-509" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.552720] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-509" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.552720] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-509" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.552720] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.552720] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.552720] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.552720] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.552720] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.552720] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1012.552720] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1012.552720] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1012.552720] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1012.553305] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1012.553305] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1012.553305] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1012.573502] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1012.573574] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1012.573905] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1012.574131] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-509" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.574467] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-e406fc67-909f-487c-a9d8-d1a96871d87c taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.574666] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-e406fc67-909f-487c-a9d8-d1a96871d87c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.574792] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-e406fc67-909f-487c-a9d8-d1a96871d87c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.575144] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-e406fc67-909f-487c-a9d8-d1a96871d87c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.575286] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e406fc67-909f-487c-a9d8-d1a96871d87c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.594267] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.594267] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.594267] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.594267] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.594267] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.608763] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb in Status: IN_PROGRESS for 2s [ 1012.715166] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.736020] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.736020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.736020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.736020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.736020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.736020] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.736020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.736020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.736020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.736020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.736020] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f is going to be updated. [ 1012.737025] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.737348] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.737547] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.737984] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.740250] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.740250] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 already deleted. [ 1012.740250] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.740250] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.740250] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.740250] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14691ab9-6ef7-4499-a5c8-0c1a0b5a8191',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.770313] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.770631] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.770631] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.770926] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.770926] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.781203] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f in Status: IN_PROGRESS for 2s [ 1013.078231] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.078511] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.078660] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.079096] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.079265] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.079443] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port e406fc67-909f-487c-a9d8-d1a96871d87c not found, creating... [ 1013.079719] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.079877] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.079994] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.080234] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.080369] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.080652] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.080809] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.080923] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.081212] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.081357] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.081496] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: e406fc67-909f-487c-a9d8-d1a96871d87c is going to be created. [ 1013.103461] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.103697] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.103796] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.104099] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.104326] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.104596] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-e406fc67-909f-487c-a9d8-d1a96871d87c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.217649] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.217649] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.217649] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.218507] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.218507] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.218507] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 is going to be updated. [ 1013.275213] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.275213] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.275213] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.275472] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.275640] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.286226] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.286226] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.286226] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.286226] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.286226] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.286459] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 already deleted. [ 1013.286459] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.292879] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 in Status: IN_PROGRESS for 2s [ 1014.090215] env[66502]: INFO networking_nsxv3.common.synchronization [None req-a1ae5934-2f28-42af-adea-0fb97985ef0c None None] Enqueued Resource ID: fdf23915-d6d1-4cd8-b4d4-d1cb873e822f with Priority: HIGHEST for action port [ 1014.090215] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdf23915-d6d1-4cd8-b4d4-d1cb873e822f with Priority: HIGHEST for action port [ 1014.090215] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-fdf23915-d6d1-4cd8-b4d4-d1cb873e822f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.091197] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fdf23915-d6d1-4cd8-b4d4-d1cb873e822f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.091372] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fdf23915-d6d1-4cd8-b4d4-d1cb873e822f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.091791] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fdf23915-d6d1-4cd8-b4d4-d1cb873e822f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.091991] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fdf23915-d6d1-4cd8-b4d4-d1cb873e822f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.229067] env[66502]: INFO networking_nsxv3.common.synchronization [req-0d11100d-82db-4981-850c-84bbcf412995 req-799b6d72-d1f6-45c7-bef3-d6f920b7b7d6 service nova] Enqueued Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGHEST for action security_group_rules [ 1014.229162] env[66502]: INFO networking_nsxv3.common.synchronization [req-0d11100d-82db-4981-850c-84bbcf412995 req-799b6d72-d1f6-45c7-bef3-d6f920b7b7d6 service nova] Enqueued Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGHEST for action security_group_members [ 1014.229303] env[66502]: INFO networking_nsxv3.common.synchronization [req-0d11100d-82db-4981-850c-84bbcf412995 req-799b6d72-d1f6-45c7-bef3-d6f920b7b7d6 service nova] Enqueued Resource ID: e406fc67-909f-487c-a9d8-d1a96871d87c with Priority: HIGHEST for action port [ 1014.229531] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGHEST for action security_group_rules [ 1014.229667] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGHEST for action security_group_members [ 1014.229941] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e406fc67-909f-487c-a9d8-d1a96871d87c with Priority: HIGHEST for action port [ 1014.230371] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aba51398-48dc-4f5e-b3cf-1da4130d58fb taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.230494] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.230562] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.230765] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.230847] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.232885] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-aba51398-48dc-4f5e-b3cf-1da4130d58fb taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.233859] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.233859] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-e406fc67-909f-487c-a9d8-d1a96871d87c taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.233859] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e406fc67-909f-487c-a9d8-d1a96871d87c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.233859] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e406fc67-909f-487c-a9d8-d1a96871d87c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.233859] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e406fc67-909f-487c-a9d8-d1a96871d87c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.234770] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e406fc67-909f-487c-a9d8-d1a96871d87c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.595072] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fdf23915-d6d1-4cd8-b4d4-d1cb873e822f [ 1014.595318] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.595489] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.595585] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.595874] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.595993] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.596149] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fdf23915-d6d1-4cd8-b4d4-d1cb873e822f already deleted. [ 1014.596295] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fdf23915-d6d1-4cd8-b4d4-d1cb873e822f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.619700] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb in Status: SUCCESS [ 1014.619894] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb deletion is rescheduled due to dependency. [ 1014.619976] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.620185] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.620445] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.620797] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.620797] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.620797] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.620996] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.621041] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.621130] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.736056] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-aba51398-48dc-4f5e-b3cf-1da4130d58fb taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.736305] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.736374] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e406fc67-909f-487c-a9d8-d1a96871d87c with status ACTIVE [ 1014.736535] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.736697] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.736810] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.736967] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.737095] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.737265] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.737349] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.737393] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.737532] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.737615] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.737793] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.737878] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.737942] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.738089] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.738162] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.738251] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e406fc67-909f-487c-a9d8-d1a96871d87c is going to be updated. [ 1014.758832] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.759158] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.759251] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.759448] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.759581] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.759733] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e406fc67-909f-487c-a9d8-d1a96871d87c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.794165] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f in Status: SUCCESS [ 1014.794165] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f deletion is rescheduled due to dependency. [ 1014.794165] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.124023] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.302708] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 in Status: SUCCESS [ 1015.303496] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.627563] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.741300] env[66502]: INFO networking_nsxv3.common.synchronization [req-d5a1eeee-3e38-417f-bcde-98cfc25c3c16 req-a708e6de-1544-4489-ad72-1ccb4d0fa784 tempest-DeleteServersTestJSON-51385704 tempest-DeleteServersTestJSON-51385704-project-member] Enqueued Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_members [ 1015.741822] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_members [ 1015.742724] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-704e5eab-aa44-4493-8c9a-0b24250e7bea taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.742724] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.742724] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.742724] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.742724] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.742724] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.743082] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.743082] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.743082] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.743184] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1016.130701] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.131098] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.131098] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.131228] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.131279] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.131370] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb is going to be updated. [ 1016.160933] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.161226] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.161226] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.161540] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.161662] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.173026] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb in Status: IN_PROGRESS for 2s [ 1016.245696] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.246514] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.246514] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.246514] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.246514] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.246514] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.246713] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.246713] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.247025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.247105] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.247157] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea is going to be updated. [ 1016.277393] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.277393] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.278386] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.278386] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.278386] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.294605] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: IN_PROGRESS for 2s [ 1018.183419] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb in Status: SUCCESS [ 1018.183695] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.183798] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.184014] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.184209] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.184324] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.184409] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.184616] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.184616] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.184836] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.184836] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.306754] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: SUCCESS [ 1018.307047] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea deletion is rescheduled due to dependency. [ 1018.307199] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.688188] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-aba51398-48dc-4f5e-b3cf-1da4130d58fb taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.689341] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.689477] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.689880] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.690194] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.690372] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.690463] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.694214] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.694427] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.697133] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.697133] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-aba51398-48dc-4f5e-b3cf-1da4130d58fb taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.697133] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.697133] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.697133] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.697133] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.697133] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.697133] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.697133] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.697133] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.697133] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.697133] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1018.883506] env[66502]: INFO networking_nsxv3.common.synchronization [None req-7858d87a-d8d4-470c-a695-981c4f1cd3c5 None None] Enqueued Resource ID: 3d007db1-96e7-4233-93dc-f5473fe21c96 with Priority: HIGHEST for action port [ 1018.885285] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d007db1-96e7-4233-93dc-f5473fe21c96 with Priority: HIGHEST for action port [ 1018.885765] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d007db1-96e7-4233-93dc-f5473fe21c96 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.886011] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d007db1-96e7-4233-93dc-f5473fe21c96" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.886159] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d007db1-96e7-4233-93dc-f5473fe21c96" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.887245] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d007db1-96e7-4233-93dc-f5473fe21c96" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.888661] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d007db1-96e7-4233-93dc-f5473fe21c96',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.199837] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aba51398-48dc-4f5e-b3cf-1da4130d58fb: rpc.has_security_group_logging(os_id): False [ 1019.228192] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.228192] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.228192] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.228192] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.228192] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.228192] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.228192] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.228192] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.228192] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.228192] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.228192] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.228192] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.228192] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.228192] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.228192] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.228796] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.228796] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.228796] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.228796] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.228796] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.228796] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb is going to be updated. [ 1019.305945] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.306119] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.306196] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.306417] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.306573] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.322023] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb in Status: IN_PROGRESS for 2s [ 1019.393820] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3d007db1-96e7-4233-93dc-f5473fe21c96 [ 1019.394609] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.394967] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.395181] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.396647] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.396647] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.396647] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3d007db1-96e7-4233-93dc-f5473fe21c96 already deleted. [ 1019.396647] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d007db1-96e7-4233-93dc-f5473fe21c96" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.799184] env[66502]: INFO networking_nsxv3.common.synchronization [None req-a8866df5-cb1f-4219-96e9-d203fa72f834 tempest-AttachVolumeTestJSON-1757376105 tempest-AttachVolumeTestJSON-1757376105-project-member] Enqueued Resource ID: c04d1b14-a58f-4eee-b805-5b75e4c0afc4 with Priority: HIGHEST for action security_group_rules [ 1019.799767] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c04d1b14-a58f-4eee-b805-5b75e4c0afc4 with Priority: HIGHEST for action security_group_rules [ 1019.800188] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c04d1b14-a58f-4eee-b805-5b75e4c0afc4 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.800362] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c04d1b14-a58f-4eee-b805-5b75e4c0afc4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.800500] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c04d1b14-a58f-4eee-b805-5b75e4c0afc4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.800941] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c04d1b14-a58f-4eee-b805-5b75e4c0afc4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.801112] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c04d1b14-a58f-4eee-b805-5b75e4c0afc4',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.918212] env[66502]: INFO networking_nsxv3.common.synchronization [None req-5bb5181d-6519-4421-8379-76ec6a3502cb tempest-AttachVolumeTestJSON-1757376105 tempest-AttachVolumeTestJSON-1757376105-project-member] Enqueued Resource ID: c04d1b14-a58f-4eee-b805-5b75e4c0afc4 with Priority: HIGHEST for action security_group_rules [ 1019.918980] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c04d1b14-a58f-4eee-b805-5b75e4c0afc4 with Priority: HIGHEST for action security_group_rules [ 1019.919201] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c04d1b14-a58f-4eee-b805-5b75e4c0afc4 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.919309] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c04d1b14-a58f-4eee-b805-5b75e4c0afc4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.326066] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.326381] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.326381] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.326497] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.326586] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.326682] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c04d1b14-a58f-4eee-b805-5b75e4c0afc4 already deleted. [ 1020.326768] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c04d1b14-a58f-4eee-b805-5b75e4c0afc4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.326946] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c04d1b14-a58f-4eee-b805-5b75e4c0afc4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.327121] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c04d1b14-a58f-4eee-b805-5b75e4c0afc4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.327209] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c04d1b14-a58f-4eee-b805-5b75e4c0afc4',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.639037] env[66502]: INFO networking_nsxv3.common.synchronization [req-15de82f7-e31f-438a-bdf6-2ce0907dead2 req-b1deb5ed-b594-42e3-9480-eb7e78740f74 tempest-ServersV294TestFqdnHostnames-23965797 tempest-ServersV294TestFqdnHostnames-23965797-project-member] Enqueued Resource ID: c7d21481-83aa-4bac-bea4-1030ed0a857b with Priority: HIGHEST for action security_group_members [ 1020.640045] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7d21481-83aa-4bac-bea4-1030ed0a857b with Priority: HIGHEST for action security_group_members [ 1020.641658] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-c7d21481-83aa-4bac-bea4-1030ed0a857b taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.641658] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c7d21481-83aa-4bac-bea4-1030ed0a857b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.641658] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c7d21481-83aa-4bac-bea4-1030ed0a857b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.641658] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c7d21481-83aa-4bac-bea4-1030ed0a857b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.641658] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.641658] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.641658] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.642076] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.642076] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.642076] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c7d21481-83aa-4bac-bea4-1030ed0a857b',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.855293] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.855293] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.855293] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.855293] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.855293] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.855293] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c04d1b14-a58f-4eee-b805-5b75e4c0afc4 already deleted. [ 1020.855293] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c04d1b14-a58f-4eee-b805-5b75e4c0afc4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.147103] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.147103] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.147246] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.147418] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.171049] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.171049] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.171049] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.171049] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.171049] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.171049] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.171049] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7d21481-83aa-4bac-bea4-1030ed0a857b is going to be updated. [ 1021.199034] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.199196] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.199196] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.199374] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.199521] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.208972] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7d21481-83aa-4bac-bea4-1030ed0a857b in Status: IN_PROGRESS for 2s [ 1021.337976] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb in Status: SUCCESS [ 1021.338304] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.604348] env[66502]: INFO networking_nsxv3.common.synchronization [None req-f62acddd-cf61-49ee-87f2-0ed68af94265 None None] Enqueued Resource ID: 37429c76-52d2-46d2-82dc-f8971ef4c0e3 with Priority: HIGHEST for action port [ 1021.605060] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 37429c76-52d2-46d2-82dc-f8971ef4c0e3 with Priority: HIGHEST for action port [ 1021.605266] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-37429c76-52d2-46d2-82dc-f8971ef4c0e3 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.605400] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-37429c76-52d2-46d2-82dc-f8971ef4c0e3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.605490] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-37429c76-52d2-46d2-82dc-f8971ef4c0e3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.605758] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-37429c76-52d2-46d2-82dc-f8971ef4c0e3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.605758] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('37429c76-52d2-46d2-82dc-f8971ef4c0e3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.107895] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 37429c76-52d2-46d2-82dc-f8971ef4c0e3 [ 1022.108181] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.108312] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.108391] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.108610] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.108701] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.108797] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:37429c76-52d2-46d2-82dc-f8971ef4c0e3 already deleted. [ 1022.108880] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-37429c76-52d2-46d2-82dc-f8971ef4c0e3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.512112] env[66502]: INFO networking_nsxv3.common.synchronization [req-d9b3a81c-1c8f-4075-9af6-2a807aa59eff req-28456f92-8c13-4c23-a628-74ffa28c89d3 tempest-ServerRescueNegativeTestJSON-1777100369 tempest-ServerRescueNegativeTestJSON-1777100369-project-member] Enqueued Resource ID: 6768b7ab-f09a-42ec-87a9-9546009ee043 with Priority: HIGHEST for action security_group_members [ 1022.512749] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6768b7ab-f09a-42ec-87a9-9546009ee043 with Priority: HIGHEST for action security_group_members [ 1022.513328] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6768b7ab-f09a-42ec-87a9-9546009ee043 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.513328] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6768b7ab-f09a-42ec-87a9-9546009ee043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.513328] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6768b7ab-f09a-42ec-87a9-9546009ee043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.513538] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6768b7ab-f09a-42ec-87a9-9546009ee043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.513582] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.514101] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.514172] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.514283] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.514371] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.514464] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6768b7ab-f09a-42ec-87a9-9546009ee043',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.836268] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-641 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.836476] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-641" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.836593] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-641" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.836868] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-641" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.837148] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.837308] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.837418] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.837658] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.837755] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.837957] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1022.838077] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1022.838179] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1022.838279] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1022.838380] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1022.838477] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1022.838598] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1022.859091] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1022.859643] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1022.859818] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1022.860069] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-641" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.860435] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-fa3f8219-3d58-4656-966e-d9260fd317aa taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.860840] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-fa3f8219-3d58-4656-966e-d9260fd317aa" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.860980] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-fa3f8219-3d58-4656-966e-d9260fd317aa" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.861371] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-fa3f8219-3d58-4656-966e-d9260fd317aa" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.861721] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa3f8219-3d58-4656-966e-d9260fd317aa',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.017410] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.017696] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.017769] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.018055] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.018179] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.018409] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.018534] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.018573] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.018812] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.018876] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.019015] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6768b7ab-f09a-42ec-87a9-9546009ee043 already deleted. [ 1023.019116] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6768b7ab-f09a-42ec-87a9-9546009ee043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.220978] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7d21481-83aa-4bac-bea4-1030ed0a857b in Status: IN_PROGRESS for 4s [ 1023.366284] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.366284] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.366284] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.366284] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.368525] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.368525] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port fa3f8219-3d58-4656-966e-d9260fd317aa not found, creating... [ 1023.368525] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.368525] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.368525] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.368525] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.368525] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.368525] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.368525] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.368525] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.369225] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.369225] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.369225] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: fa3f8219-3d58-4656-966e-d9260fd317aa is going to be created. [ 1023.392354] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.392559] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.392680] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.392961] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.393211] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.393429] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-fa3f8219-3d58-4656-966e-d9260fd317aa" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.122178] env[66502]: INFO networking_nsxv3.common.synchronization [req-d9b3a81c-1c8f-4075-9af6-2a807aa59eff req-54ec1dce-4271-4a9c-8e32-cef66d99272c service nova] Enqueued Resource ID: 6768b7ab-f09a-42ec-87a9-9546009ee043 with Priority: HIGHEST for action security_group_rules [ 1024.122468] env[66502]: INFO networking_nsxv3.common.synchronization [req-d9b3a81c-1c8f-4075-9af6-2a807aa59eff req-54ec1dce-4271-4a9c-8e32-cef66d99272c service nova] Enqueued Resource ID: 6768b7ab-f09a-42ec-87a9-9546009ee043 with Priority: HIGHEST for action security_group_members [ 1024.122585] env[66502]: INFO networking_nsxv3.common.synchronization [req-d9b3a81c-1c8f-4075-9af6-2a807aa59eff req-54ec1dce-4271-4a9c-8e32-cef66d99272c service nova] Enqueued Resource ID: fa3f8219-3d58-4656-966e-d9260fd317aa with Priority: HIGHEST for action port [ 1024.123049] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6768b7ab-f09a-42ec-87a9-9546009ee043 with Priority: HIGHEST for action security_group_rules [ 1024.123178] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6768b7ab-f09a-42ec-87a9-9546009ee043 with Priority: HIGHEST for action security_group_members [ 1024.123269] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa3f8219-3d58-4656-966e-d9260fd317aa with Priority: HIGHEST for action port [ 1024.123535] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6768b7ab-f09a-42ec-87a9-9546009ee043 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.123648] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6768b7ab-f09a-42ec-87a9-9546009ee043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.123982] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6768b7ab-f09a-42ec-87a9-9546009ee043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.123982] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6768b7ab-f09a-42ec-87a9-9546009ee043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.125237] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6768b7ab-f09a-42ec-87a9-9546009ee043',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.126187] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6768b7ab-f09a-42ec-87a9-9546009ee043 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.126187] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6768b7ab-f09a-42ec-87a9-9546009ee043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.126187] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6768b7ab-f09a-42ec-87a9-9546009ee043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.126187] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6768b7ab-f09a-42ec-87a9-9546009ee043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.126187] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.126187] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.126187] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.126457] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.127216] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.127322] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6768b7ab-f09a-42ec-87a9-9546009ee043',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.129221] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa3f8219-3d58-4656-966e-d9260fd317aa taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.129221] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa3f8219-3d58-4656-966e-d9260fd317aa" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.129352] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa3f8219-3d58-4656-966e-d9260fd317aa" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.129406] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa3f8219-3d58-4656-966e-d9260fd317aa" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.129480] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa3f8219-3d58-4656-966e-d9260fd317aa',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.632080] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fa3f8219-3d58-4656-966e-d9260fd317aa with status ACTIVE [ 1024.632343] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.632486] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.632589] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.632818] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.632856] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.633040] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.633143] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.633197] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.633348] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.633414] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.633592] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.633684] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.633743] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.633879] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.633948] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.634040] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fa3f8219-3d58-4656-966e-d9260fd317aa is going to be updated. [ 1024.635210] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6768b7ab-f09a-42ec-87a9-9546009ee043 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.635312] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6768b7ab-f09a-42ec-87a9-9546009ee043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.635473] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6768b7ab-f09a-42ec-87a9-9546009ee043',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.655962] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.656279] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.656279] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.656377] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.656489] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.656643] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa3f8219-3d58-4656-966e-d9260fd317aa" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.138477] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6768b7ab-f09a-42ec-87a9-9546009ee043',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.232082] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c7d21481-83aa-4bac-bea4-1030ed0a857b in Status: SUCCESS [ 1025.232275] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c7d21481-83aa-4bac-bea4-1030ed0a857b deletion is rescheduled due to dependency. [ 1025.232386] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c7d21481-83aa-4bac-bea4-1030ed0a857b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.643599] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.643791] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.643791] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.644011] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.644115] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.644211] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6768b7ab-f09a-42ec-87a9-9546009ee043 is going to be created. [ 1025.671466] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.671753] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.671753] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.671875] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.672040] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.681946] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6768b7ab-f09a-42ec-87a9-9546009ee043 in Status: UNINITIALIZED for 2s [ 1027.478474] env[66502]: INFO networking_nsxv3.common.synchronization [req-0bfaa1d8-7b25-42d6-9b84-3460e554f272 req-4a606112-f6bf-484a-bbb5-2dfdacc6dcf2 tempest-AttachInterfacesTestJSON-1531294335 tempest-AttachInterfacesTestJSON-1531294335-project-member] Enqueued Resource ID: ee8e701d-05aa-43ae-8307-095303edba0f with Priority: HIGHEST for action security_group_members [ 1027.478890] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee8e701d-05aa-43ae-8307-095303edba0f with Priority: HIGHEST for action security_group_members [ 1027.479214] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee8e701d-05aa-43ae-8307-095303edba0f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.479347] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee8e701d-05aa-43ae-8307-095303edba0f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.479419] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee8e701d-05aa-43ae-8307-095303edba0f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.479660] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee8e701d-05aa-43ae-8307-095303edba0f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.479815] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.479908] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.479966] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.480129] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.480216] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.480307] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee8e701d-05aa-43ae-8307-095303edba0f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.696098] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6768b7ab-f09a-42ec-87a9-9546009ee043 in Status: SUCCESS [ 1027.696309] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6768b7ab-f09a-42ec-87a9-9546009ee043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.696473] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6768b7ab-f09a-42ec-87a9-9546009ee043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.696688] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6768b7ab-f09a-42ec-87a9-9546009ee043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.696874] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.697020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.698074] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.698074] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.698074] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.698074] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6768b7ab-f09a-42ec-87a9-9546009ee043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.698074] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6768b7ab-f09a-42ec-87a9-9546009ee043',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.811104] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-584 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.811367] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-584" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.811438] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-584" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.811818] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-584" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.812283] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.812507] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.812666] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.812893] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.813048] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.813264] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1027.813381] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1027.813492] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1027.813601] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1027.813710] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1027.813814] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1027.813993] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1027.835095] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1027.835095] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1027.835095] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1027.835095] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-584" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.835306] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-24852432-58ef-4d6b-8991-87ac2d7dd52a taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.835474] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-24852432-58ef-4d6b-8991-87ac2d7dd52a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.835631] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-24852432-58ef-4d6b-8991-87ac2d7dd52a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.836019] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-24852432-58ef-4d6b-8991-87ac2d7dd52a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.836187] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24852432-58ef-4d6b-8991-87ac2d7dd52a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.982431] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.982576] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.982661] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.982859] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.982954] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.983157] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.983257] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.983314] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.983459] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.983555] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.983622] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee8e701d-05aa-43ae-8307-095303edba0f already deleted. [ 1027.983742] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee8e701d-05aa-43ae-8307-095303edba0f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.200415] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6768b7ab-f09a-42ec-87a9-9546009ee043',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.338594] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.338836] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.339098] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.339311] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.339518] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.339681] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port 24852432-58ef-4d6b-8991-87ac2d7dd52a not found, creating... [ 1028.339950] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.340207] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.340296] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.340464] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.340603] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.340888] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.341058] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.341180] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.341392] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.341524] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.341673] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: 24852432-58ef-4d6b-8991-87ac2d7dd52a is going to be created. [ 1028.365545] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.365806] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.365909] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.366292] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.366533] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.366860] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-24852432-58ef-4d6b-8991-87ac2d7dd52a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.702471] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6768b7ab-f09a-42ec-87a9-9546009ee043: rpc.has_security_group_logging(os_id): False [ 1028.722662] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.722839] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.722916] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.723137] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.723270] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.723468] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.723613] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.723665] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.723773] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.723853] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.723945] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6768b7ab-f09a-42ec-87a9-9546009ee043 is going to be created. [ 1028.783449] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.783651] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.783651] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.784287] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.784287] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.795491] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6768b7ab-f09a-42ec-87a9-9546009ee043 in Status: IN_PROGRESS for 2s [ 1029.107491] env[66502]: INFO networking_nsxv3.common.synchronization [req-0bfaa1d8-7b25-42d6-9b84-3460e554f272 req-03b93332-a3e6-403f-a863-a12d42395f98 service nova] Enqueued Resource ID: ee8e701d-05aa-43ae-8307-095303edba0f with Priority: HIGHEST for action security_group_rules [ 1029.107761] env[66502]: INFO networking_nsxv3.common.synchronization [req-0bfaa1d8-7b25-42d6-9b84-3460e554f272 req-03b93332-a3e6-403f-a863-a12d42395f98 service nova] Enqueued Resource ID: ee8e701d-05aa-43ae-8307-095303edba0f with Priority: HIGHEST for action security_group_members [ 1029.107904] env[66502]: INFO networking_nsxv3.common.synchronization [req-0bfaa1d8-7b25-42d6-9b84-3460e554f272 req-03b93332-a3e6-403f-a863-a12d42395f98 service nova] Enqueued Resource ID: 24852432-58ef-4d6b-8991-87ac2d7dd52a with Priority: HIGHEST for action port [ 1029.108510] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee8e701d-05aa-43ae-8307-095303edba0f with Priority: HIGHEST for action security_group_rules [ 1029.108641] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee8e701d-05aa-43ae-8307-095303edba0f with Priority: HIGHEST for action security_group_members [ 1029.108737] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 24852432-58ef-4d6b-8991-87ac2d7dd52a with Priority: HIGHEST for action port [ 1029.109015] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee8e701d-05aa-43ae-8307-095303edba0f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.109160] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee8e701d-05aa-43ae-8307-095303edba0f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.109230] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee8e701d-05aa-43ae-8307-095303edba0f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.109435] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee8e701d-05aa-43ae-8307-095303edba0f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.109529] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee8e701d-05aa-43ae-8307-095303edba0f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.110915] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee8e701d-05aa-43ae-8307-095303edba0f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.111047] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee8e701d-05aa-43ae-8307-095303edba0f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.111121] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee8e701d-05aa-43ae-8307-095303edba0f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.111329] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee8e701d-05aa-43ae-8307-095303edba0f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.111487] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.111581] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.111646] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.111795] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.111879] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.111964] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee8e701d-05aa-43ae-8307-095303edba0f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.112984] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-24852432-58ef-4d6b-8991-87ac2d7dd52a taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.112984] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-24852432-58ef-4d6b-8991-87ac2d7dd52a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.112984] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-24852432-58ef-4d6b-8991-87ac2d7dd52a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.112984] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-24852432-58ef-4d6b-8991-87ac2d7dd52a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.113260] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('24852432-58ef-4d6b-8991-87ac2d7dd52a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.615562] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ee8e701d-05aa-43ae-8307-095303edba0f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.616389] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee8e701d-05aa-43ae-8307-095303edba0f taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.617037] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee8e701d-05aa-43ae-8307-095303edba0f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.617037] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 24852432-58ef-4d6b-8991-87ac2d7dd52a with status ACTIVE [ 1029.617161] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.617257] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.617330] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.617540] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.617632] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.617845] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.617916] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.617951] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.620987] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.621222] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.621651] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.621651] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.621651] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.621768] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.624733] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.624733] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 24852432-58ef-4d6b-8991-87ac2d7dd52a is going to be updated. [ 1029.648153] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.648320] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.648382] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.648600] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.648713] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.648895] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-24852432-58ef-4d6b-8991-87ac2d7dd52a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.123783] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ee8e701d-05aa-43ae-8307-095303edba0f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.627332] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.627332] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.627332] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.627332] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.627672] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.627837] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee8e701d-05aa-43ae-8307-095303edba0f is going to be created. [ 1030.761356] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.761492] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.761580] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.761854] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.762074] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.778260] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee8e701d-05aa-43ae-8307-095303edba0f in Status: UNINITIALIZED for 2s [ 1030.809384] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6768b7ab-f09a-42ec-87a9-9546009ee043 in Status: SUCCESS [ 1030.809653] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6768b7ab-f09a-42ec-87a9-9546009ee043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.600954] env[66502]: INFO networking_nsxv3.common.synchronization [req-09dc670f-6880-4bae-8b9f-baace87a59a7 req-56604e47-f8c4-4bb7-9959-74144e79eb86 tempest-FloatingIPsAssociationNegativeTestJSON-1645844367 tempest-FloatingIPsAssociationNegativeTestJSON-1645844367-project-member] Enqueued Resource ID: c6a88e37-d54b-42a9-b5c6-a059d6ab069a with Priority: HIGHEST for action security_group_members [ 1032.601562] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6a88e37-d54b-42a9-b5c6-a059d6ab069a with Priority: HIGHEST for action security_group_members [ 1032.601869] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6a88e37-d54b-42a9-b5c6-a059d6ab069a taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.601981] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6a88e37-d54b-42a9-b5c6-a059d6ab069a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.601981] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6a88e37-d54b-42a9-b5c6-a059d6ab069a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.603155] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6a88e37-d54b-42a9-b5c6-a059d6ab069a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.603324] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.603434] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.603504] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.603910] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.604029] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.604129] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6a88e37-d54b-42a9-b5c6-a059d6ab069a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.789015] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee8e701d-05aa-43ae-8307-095303edba0f in Status: SUCCESS [ 1032.789240] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee8e701d-05aa-43ae-8307-095303edba0f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.789409] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee8e701d-05aa-43ae-8307-095303edba0f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.789628] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee8e701d-05aa-43ae-8307-095303edba0f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.789814] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.789928] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.790021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.790173] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.790265] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.790366] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee8e701d-05aa-43ae-8307-095303edba0f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.790459] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ee8e701d-05aa-43ae-8307-095303edba0f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.106751] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.107026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.108620] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.108813] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.108950] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.109256] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.109408] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.109488] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.109724] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.109849] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.109976] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6a88e37-d54b-42a9-b5c6-a059d6ab069a already deleted. [ 1033.110138] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6a88e37-d54b-42a9-b5c6-a059d6ab069a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.128435] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-913 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.128435] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-913" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.128435] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-913" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.128435] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-913" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.128435] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.128978] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.129424] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.130103] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.130536] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.132860] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1033.132860] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1033.132860] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1033.132860] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1033.132860] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1033.132860] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1033.132860] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1033.158251] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1033.158460] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1033.158598] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1033.158772] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-913" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.159145] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-e167c110-f128-4f08-a903-e43559483e17 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.159335] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-e167c110-f128-4f08-a903-e43559483e17" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.159462] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-e167c110-f128-4f08-a903-e43559483e17" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.159818] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-e167c110-f128-4f08-a903-e43559483e17" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.159968] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e167c110-f128-4f08-a903-e43559483e17',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.292295] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ee8e701d-05aa-43ae-8307-095303edba0f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.664372] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.664744] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.664842] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.665129] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.665362] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.665542] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port e167c110-f128-4f08-a903-e43559483e17 not found, creating... [ 1033.665723] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.665881] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.666040] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.666359] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.666573] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.666874] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.667045] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.667306] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.667544] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.667888] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.668072] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: e167c110-f128-4f08-a903-e43559483e17 is going to be created. [ 1033.689055] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.689353] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.689525] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.689828] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.690087] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.690328] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-e167c110-f128-4f08-a903-e43559483e17" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.794671] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ee8e701d-05aa-43ae-8307-095303edba0f: rpc.has_security_group_logging(os_id): False [ 1033.820645] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.820808] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.820874] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.821072] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.821159] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.821402] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.821520] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.821581] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.821735] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.821825] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.821892] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee8e701d-05aa-43ae-8307-095303edba0f is going to be created. [ 1033.895876] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.896103] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.896103] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.896400] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.896625] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.927299] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee8e701d-05aa-43ae-8307-095303edba0f in Status: IN_PROGRESS for 2s [ 1034.398165] env[66502]: INFO networking_nsxv3.common.synchronization [req-09dc670f-6880-4bae-8b9f-baace87a59a7 req-e5a16183-5a2f-4400-86d2-a29bb0990446 service nova] Enqueued Resource ID: c6a88e37-d54b-42a9-b5c6-a059d6ab069a with Priority: HIGHEST for action security_group_rules [ 1034.398356] env[66502]: INFO networking_nsxv3.common.synchronization [req-09dc670f-6880-4bae-8b9f-baace87a59a7 req-e5a16183-5a2f-4400-86d2-a29bb0990446 service nova] Enqueued Resource ID: c6a88e37-d54b-42a9-b5c6-a059d6ab069a with Priority: HIGHEST for action security_group_members [ 1034.398494] env[66502]: INFO networking_nsxv3.common.synchronization [req-09dc670f-6880-4bae-8b9f-baace87a59a7 req-e5a16183-5a2f-4400-86d2-a29bb0990446 service nova] Enqueued Resource ID: e167c110-f128-4f08-a903-e43559483e17 with Priority: HIGHEST for action port [ 1034.399310] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6a88e37-d54b-42a9-b5c6-a059d6ab069a with Priority: HIGHEST for action security_group_rules [ 1034.399310] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6a88e37-d54b-42a9-b5c6-a059d6ab069a with Priority: HIGHEST for action security_group_members [ 1034.399310] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e167c110-f128-4f08-a903-e43559483e17 with Priority: HIGHEST for action port [ 1034.399698] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c6a88e37-d54b-42a9-b5c6-a059d6ab069a taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.399698] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c6a88e37-d54b-42a9-b5c6-a059d6ab069a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.399809] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c6a88e37-d54b-42a9-b5c6-a059d6ab069a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.400036] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c6a88e37-d54b-42a9-b5c6-a059d6ab069a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.400120] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c6a88e37-d54b-42a9-b5c6-a059d6ab069a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.404067] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6a88e37-d54b-42a9-b5c6-a059d6ab069a taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.404067] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6a88e37-d54b-42a9-b5c6-a059d6ab069a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.404067] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6a88e37-d54b-42a9-b5c6-a059d6ab069a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.404067] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6a88e37-d54b-42a9-b5c6-a059d6ab069a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.404067] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.404067] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.404067] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.404067] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.404067] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.404067] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6a88e37-d54b-42a9-b5c6-a059d6ab069a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.404567] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-e167c110-f128-4f08-a903-e43559483e17 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.404885] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e167c110-f128-4f08-a903-e43559483e17" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.404885] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e167c110-f128-4f08-a903-e43559483e17" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.404885] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e167c110-f128-4f08-a903-e43559483e17" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.405073] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e167c110-f128-4f08-a903-e43559483e17',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.907365] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6a88e37-d54b-42a9-b5c6-a059d6ab069a taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.907365] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6a88e37-d54b-42a9-b5c6-a059d6ab069a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.913023] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c6a88e37-d54b-42a9-b5c6-a059d6ab069a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1034.913023] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e167c110-f128-4f08-a903-e43559483e17 with status ACTIVE [ 1034.913023] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.913023] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.913023] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.913023] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.913023] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.913023] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.913023] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.913023] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.913023] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.913023] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.913023] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.913023] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.913023] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.913023] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.913843] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.913843] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e167c110-f128-4f08-a903-e43559483e17 is going to be updated. [ 1034.936784] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.937414] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.937651] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.937998] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.938361] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.939055] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e167c110-f128-4f08-a903-e43559483e17" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.242694] env[66502]: INFO networking_nsxv3.common.synchronization [req-273c3e3b-7703-4efa-bfca-6df60d01d619 req-f9b352fb-7312-4c7b-835b-993544db1201 tempest-ServersTestJSON-1210226259 tempest-ServersTestJSON-1210226259-project-member] Enqueued Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_members [ 1035.243432] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_members [ 1035.243727] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.243981] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.243981] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.244210] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.245348] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.245561] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.245561] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.245715] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.246036] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.246036] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.416295] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c6a88e37-d54b-42a9-b5c6-a059d6ab069a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.712679] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-708 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.712867] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-708" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.713016] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-708" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.713264] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-708" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.713642] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.713802] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.713918] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.714161] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.714308] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.714510] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1035.714622] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1035.714728] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1035.714828] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1035.714934] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1035.715052] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1035.715214] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1035.734795] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1035.737804] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1035.737804] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1035.737804] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-708" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.737804] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-a975b242-ce7e-4a7f-bba1-f83d48608481 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.737804] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-a975b242-ce7e-4a7f-bba1-f83d48608481" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.737804] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-a975b242-ce7e-4a7f-bba1-f83d48608481" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.737804] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-a975b242-ce7e-4a7f-bba1-f83d48608481" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.737804] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a975b242-ce7e-4a7f-bba1-f83d48608481',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.748710] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.919186] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.919186] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.919186] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.919186] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.920625] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.920625] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6a88e37-d54b-42a9-b5c6-a059d6ab069a is going to be created. [ 1035.941415] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ee8e701d-05aa-43ae-8307-095303edba0f in Status: SUCCESS [ 1035.941415] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee8e701d-05aa-43ae-8307-095303edba0f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.948087] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.948369] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.948369] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.948517] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.948679] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.961406] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6a88e37-d54b-42a9-b5c6-a059d6ab069a in Status: UNINITIALIZED for 2s [ 1036.020945] env[66502]: INFO networking_nsxv3.common.synchronization [None req-924423b6-7546-4203-a567-bd97f8a83b1a None None] Enqueued Resource ID: d98085c2-49c9-4073-8d4f-9b7f9facbaea with Priority: HIGHEST for action port [ 1036.021608] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d98085c2-49c9-4073-8d4f-9b7f9facbaea with Priority: HIGHEST for action port [ 1036.022016] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-d98085c2-49c9-4073-8d4f-9b7f9facbaea taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.022174] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d98085c2-49c9-4073-8d4f-9b7f9facbaea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.022245] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d98085c2-49c9-4073-8d4f-9b7f9facbaea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.022652] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d98085c2-49c9-4073-8d4f-9b7f9facbaea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.022652] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d98085c2-49c9-4073-8d4f-9b7f9facbaea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.241603] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.241603] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.241603] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.241894] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.241980] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.242290] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port a975b242-ce7e-4a7f-bba1-f83d48608481 not found, creating... [ 1036.242436] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.242576] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.242667] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.242891] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.243037] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.243315] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.243473] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.243587] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.243802] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.243933] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.244217] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: a975b242-ce7e-4a7f-bba1-f83d48608481 is going to be created. [ 1036.254112] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.266796] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.267040] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.267317] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.267566] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.267874] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.268125] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-a975b242-ce7e-4a7f-bba1-f83d48608481" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.525028] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d98085c2-49c9-4073-8d4f-9b7f9facbaea [ 1036.525282] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.525464] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.525514] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.525690] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.525780] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.525907] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d98085c2-49c9-4073-8d4f-9b7f9facbaea already deleted. [ 1036.525958] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d98085c2-49c9-4073-8d4f-9b7f9facbaea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.756659] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.756659] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.756659] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.757493] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.757493] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.757493] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d226a97-2d69-4706-b98b-565700008c6f is going to be updated. [ 1036.791224] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.791488] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.791488] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.791646] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.791798] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.802217] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: IN_PROGRESS for 2s [ 1037.035171] env[66502]: INFO networking_nsxv3.common.synchronization [req-273c3e3b-7703-4efa-bfca-6df60d01d619 req-44da6573-2630-4001-8960-1637d9b272d7 service nova] Enqueued Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_rules [ 1037.035424] env[66502]: INFO networking_nsxv3.common.synchronization [req-273c3e3b-7703-4efa-bfca-6df60d01d619 req-44da6573-2630-4001-8960-1637d9b272d7 service nova] Enqueued Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_members [ 1037.035424] env[66502]: INFO networking_nsxv3.common.synchronization [req-273c3e3b-7703-4efa-bfca-6df60d01d619 req-44da6573-2630-4001-8960-1637d9b272d7 service nova] Enqueued Resource ID: a975b242-ce7e-4a7f-bba1-f83d48608481 with Priority: HIGHEST for action port [ 1037.035949] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_rules [ 1037.036092] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_members [ 1037.036187] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a975b242-ce7e-4a7f-bba1-f83d48608481 with Priority: HIGHEST for action port [ 1037.036457] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.037299] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.037378] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.037573] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.037657] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.038890] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.039016] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.039481] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-a975b242-ce7e-4a7f-bba1-f83d48608481 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.039481] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a975b242-ce7e-4a7f-bba1-f83d48608481" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.039481] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a975b242-ce7e-4a7f-bba1-f83d48608481" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.039801] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a975b242-ce7e-4a7f-bba1-f83d48608481" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.039801] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a975b242-ce7e-4a7f-bba1-f83d48608481',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.541109] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.541247] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.541452] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a975b242-ce7e-4a7f-bba1-f83d48608481 with status ACTIVE [ 1037.541627] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.541735] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.541799] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.542048] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.542148] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.542336] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.542406] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.542577] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.542848] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.542848] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.542977] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.543041] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.543119] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.543228] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.543346] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.543396] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a975b242-ce7e-4a7f-bba1-f83d48608481 is going to be updated. [ 1037.570842] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.570842] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.570842] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.571183] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.571183] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.571248] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a975b242-ce7e-4a7f-bba1-f83d48608481" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.627761] env[66502]: INFO networking_nsxv3.common.synchronization [req-8e38ef46-7954-4fed-afdc-af8e4c7894df req-dcdcf889-37bc-4869-9559-cbe714b410c5 tempest-AttachVolumeShelveTestJSON-163785099 tempest-AttachVolumeShelveTestJSON-163785099-project-member] Enqueued Resource ID: 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 with Priority: HIGHEST for action security_group_members [ 1037.628352] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 with Priority: HIGHEST for action security_group_members [ 1037.629969] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.629969] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.629969] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.630228] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.630228] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.630333] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.630455] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.630569] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.630663] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.630763] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14691ab9-6ef7-4499-a5c8-0c1a0b5a8191',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.974891] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6a88e37-d54b-42a9-b5c6-a059d6ab069a in Status: SUCCESS [ 1037.974891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6a88e37-d54b-42a9-b5c6-a059d6ab069a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.974891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6a88e37-d54b-42a9-b5c6-a059d6ab069a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.974891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6a88e37-d54b-42a9-b5c6-a059d6ab069a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.974891] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.974891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.974891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.974891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.974891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.974891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6a88e37-d54b-42a9-b5c6-a059d6ab069a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.974891] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c6a88e37-d54b-42a9-b5c6-a059d6ab069a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.082491] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-458 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.082491] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-458" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.082491] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-458" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.082491] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-458" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.082491] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.083126] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.083496] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.083875] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.084590] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.084815] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1038.087020] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1038.087020] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1038.087020] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1038.087020] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1038.087020] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1038.087020] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1038.109431] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1038.109431] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1038.109431] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1038.109431] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-458" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.109431] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-c21594ab-8c19-475a-9f56-a209a9319121 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.109431] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-c21594ab-8c19-475a-9f56-a209a9319121" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.109431] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-c21594ab-8c19-475a-9f56-a209a9319121" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.109431] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-c21594ab-8c19-475a-9f56-a209a9319121" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.109431] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c21594ab-8c19-475a-9f56-a209a9319121',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.116143] env[66502]: INFO networking_nsxv3.common.synchronization [None req-5f25dd5d-e478-487b-9e7d-9269b582e064 None None] Enqueued Resource ID: 267ff02a-3e17-4bbb-989b-817cb4764495 with Priority: HIGHEST for action port [ 1038.116259] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 267ff02a-3e17-4bbb-989b-817cb4764495 with Priority: HIGHEST for action port [ 1038.116822] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-267ff02a-3e17-4bbb-989b-817cb4764495 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.116937] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-267ff02a-3e17-4bbb-989b-817cb4764495" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.117362] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-267ff02a-3e17-4bbb-989b-817cb4764495" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.117362] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-267ff02a-3e17-4bbb-989b-817cb4764495" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.117538] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('267ff02a-3e17-4bbb-989b-817cb4764495',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.136326] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.136548] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.136613] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.136790] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.136880] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.137088] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.137188] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.137324] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.137431] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.137514] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.137571] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 already deleted. [ 1038.137645] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.442197] env[66502]: INFO networking_nsxv3.common.synchronization [req-47fa0a18-33af-40e1-bb2d-64c42ae7cf37 req-4a3b317e-96f4-42b4-b0d1-ac4789dea969 tempest-ServersAdminTestJSON-292997046 tempest-ServersAdminTestJSON-292997046-project-member] Enqueued Resource ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 with Priority: HIGHEST for action security_group_members [ 1038.442768] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 with Priority: HIGHEST for action security_group_members [ 1038.444066] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.444066] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.444066] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.444066] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.444331] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.444331] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.444432] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.444609] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.444660] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.445276] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.478237] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6a88e37-d54b-42a9-b5c6-a059d6ab069a taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.478237] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6a88e37-d54b-42a9-b5c6-a059d6ab069a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.478237] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6a88e37-d54b-42a9-b5c6-a059d6ab069a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.478237] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6a88e37-d54b-42a9-b5c6-a059d6ab069a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.478237] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.478237] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.478237] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.478779] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.478779] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.478779] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6a88e37-d54b-42a9-b5c6-a059d6ab069a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.478779] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6a88e37-d54b-42a9-b5c6-a059d6ab069a taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.478779] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6a88e37-d54b-42a9-b5c6-a059d6ab069a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.479134] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6a88e37-d54b-42a9-b5c6-a059d6ab069a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.479134] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6a88e37-d54b-42a9-b5c6-a059d6ab069a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.479263] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.479322] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.479411] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.479586] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.479642] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.479723] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6a88e37-d54b-42a9-b5c6-a059d6ab069a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.480216] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c6a88e37-d54b-42a9-b5c6-a059d6ab069a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.613213] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.614038] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.614038] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.614038] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.614252] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.614294] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port c21594ab-8c19-475a-9f56-a209a9319121 not found, creating... [ 1038.614646] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.614800] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.614928] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.615221] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.615373] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.615731] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.615962] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.616661] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.616946] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.617124] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.617387] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: c21594ab-8c19-475a-9f56-a209a9319121 is going to be created. [ 1038.619212] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 267ff02a-3e17-4bbb-989b-817cb4764495 [ 1038.619425] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.619577] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.619684] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.619949] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.620174] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.620297] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:267ff02a-3e17-4bbb-989b-817cb4764495 already deleted. [ 1038.620402] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-267ff02a-3e17-4bbb-989b-817cb4764495" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.640224] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.640549] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.640715] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.641105] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.641471] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.641751] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-c21594ab-8c19-475a-9f56-a209a9319121" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.816563] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: SUCCESS [ 1038.820019] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.820019] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.820739] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.820913] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.821570] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.821570] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.821570] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.821747] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.821747] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.948808] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.948990] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.949053] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.949257] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.971388] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.971656] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.972529] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.972529] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.972529] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.972529] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.972529] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 is going to be updated. [ 1038.982926] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c6a88e37-d54b-42a9-b5c6-a059d6ab069a: rpc.has_security_group_logging(os_id): False [ 1039.001482] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.001671] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.001671] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.001854] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.001996] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.004210] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.004210] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.004210] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.004210] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.004487] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.004487] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.004568] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.004673] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.005247] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.005247] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.005247] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.005247] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.005459] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.005459] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.005574] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.005957] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.005957] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.005957] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.005957] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.006539] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.006630] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c6a88e37-d54b-42a9-b5c6-a059d6ab069a is going to be created. [ 1039.018064] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 in Status: IN_PROGRESS for 2s [ 1039.094529] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.094919] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.094919] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.094919] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.095118] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.111045] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6a88e37-d54b-42a9-b5c6-a059d6ab069a in Status: IN_PROGRESS for 2s [ 1039.326435] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.415584] env[66502]: INFO networking_nsxv3.common.synchronization [req-8e38ef46-7954-4fed-afdc-af8e4c7894df req-c468bbac-3a43-47ea-a6eb-c402a52cc190 service nova] Enqueued Resource ID: 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 with Priority: HIGHEST for action security_group_rules [ 1039.415584] env[66502]: INFO networking_nsxv3.common.synchronization [req-8e38ef46-7954-4fed-afdc-af8e4c7894df req-c468bbac-3a43-47ea-a6eb-c402a52cc190 service nova] Enqueued Resource ID: 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 with Priority: HIGHEST for action security_group_members [ 1039.415584] env[66502]: INFO networking_nsxv3.common.synchronization [req-8e38ef46-7954-4fed-afdc-af8e4c7894df req-c468bbac-3a43-47ea-a6eb-c402a52cc190 service nova] Enqueued Resource ID: c21594ab-8c19-475a-9f56-a209a9319121 with Priority: HIGHEST for action port [ 1039.417584] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 with Priority: HIGHEST for action security_group_rules [ 1039.417584] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 with Priority: HIGHEST for action security_group_members [ 1039.417584] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c21594ab-8c19-475a-9f56-a209a9319121 with Priority: HIGHEST for action port [ 1039.417584] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.417584] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.418095] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.418095] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.418095] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14691ab9-6ef7-4499-a5c8-0c1a0b5a8191',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.419063] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.419482] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.421791] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.421791] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.421791] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.421791] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.421791] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.421791] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.421791] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.421791] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14691ab9-6ef7-4499-a5c8-0c1a0b5a8191',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.421791] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-c21594ab-8c19-475a-9f56-a209a9319121 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.422269] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c21594ab-8c19-475a-9f56-a209a9319121" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.422269] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c21594ab-8c19-475a-9f56-a209a9319121" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.422269] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c21594ab-8c19-475a-9f56-a209a9319121" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.422269] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c21594ab-8c19-475a-9f56-a209a9319121',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.828640] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.924167] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('14691ab9-6ef7-4499-a5c8-0c1a0b5a8191',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.926098] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.926218] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.926407] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c21594ab-8c19-475a-9f56-a209a9319121 with status ACTIVE [ 1039.926751] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.926971] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.927052] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.927366] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.927477] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.927713] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.927814] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.927897] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.928080] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.928363] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.928484] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.928562] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.928611] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.928758] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.928836] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.928997] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c21594ab-8c19-475a-9f56-a209a9319121 is going to be updated. [ 1039.955832] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.955832] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.955832] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.955832] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.955832] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.956235] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c21594ab-8c19-475a-9f56-a209a9319121" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.334837] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.335340] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.335340] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.335340] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.335517] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.335556] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d226a97-2d69-4706-b98b-565700008c6f is going to be updated. [ 1040.376039] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.376039] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.376039] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.376039] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.376039] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.385513] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: IN_PROGRESS for 2s [ 1040.432418] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('14691ab9-6ef7-4499-a5c8-0c1a0b5a8191',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.938747] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.938747] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.938909] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.939040] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.939137] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.939237] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 is going to be created. [ 1040.965633] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.965804] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.965855] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.966193] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.966294] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.975772] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 in Status: UNINITIALIZED for 2s [ 1041.029222] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 in Status: SUCCESS [ 1041.029409] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 deletion is rescheduled due to dependency. [ 1041.029645] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.119291] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c6a88e37-d54b-42a9-b5c6-a059d6ab069a in Status: SUCCESS [ 1041.119513] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c6a88e37-d54b-42a9-b5c6-a059d6ab069a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.395788] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: SUCCESS [ 1042.396065] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.396182] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.396475] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.396794] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.396794] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.396928] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.397016] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.397118] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.397205] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.397296] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.706376] env[66502]: INFO networking_nsxv3.common.synchronization [req-0f97f0d0-e6eb-43de-bb96-5bbbe4fa57a3 req-f079b251-02df-4913-91ef-976ad3662e2e tempest-AttachVolumeNegativeTest-686526601 tempest-AttachVolumeNegativeTest-686526601-project-member] Enqueued Resource ID: cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66 with Priority: HIGHEST for action security_group_members [ 1042.708730] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66 with Priority: HIGHEST for action security_group_members [ 1042.709271] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.709392] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.709453] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.709654] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.709805] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.709903] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.709965] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.710127] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.710213] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.710305] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.901667] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.901835] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.901905] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.902153] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.902319] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.902428] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.902540] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.902645] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.902734] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.902820] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.902980] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.903092] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.903151] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.903291] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.903429] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.903520] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.903579] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.903718] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.903807] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.903889] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.904033] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.989836] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 in Status: SUCCESS [ 1042.989836] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.989836] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.990136] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.990246] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.990381] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.990440] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.990605] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.992067] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.992067] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.992067] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('14691ab9-6ef7-4499-a5c8-0c1a0b5a8191',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.212633] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.212793] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.212865] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.213164] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.213250] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.213408] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.213508] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.213570] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.213723] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.213799] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.213883] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66 is going to be updated. [ 1043.239948] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.240169] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.240169] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.240372] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.240515] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.251119] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66 in Status: IN_PROGRESS for 2s [ 1043.407026] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9d226a97-2d69-4706-b98b-565700008c6f: rpc.has_security_group_logging(os_id): False [ 1043.427711] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.427711] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.427991] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.428041] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.428131] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.432021] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.432021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.432021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.432021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.432021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.432021] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.432021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.432021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.432021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.432021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.432021] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.432021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.432021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.432021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.432783] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.432783] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d226a97-2d69-4706-b98b-565700008c6f is going to be updated. [ 1043.493104] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.493254] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.493319] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.493559] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.493826] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.494841] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('14691ab9-6ef7-4499-a5c8-0c1a0b5a8191',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.514772] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: IN_PROGRESS for 2s [ 1043.999185] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191: rpc.has_security_group_logging(os_id): False [ 1044.021646] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.021823] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.021945] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.023687] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.023687] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.023687] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.023687] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.023687] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.024218] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.024288] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.024507] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 is going to be created. [ 1044.094812] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.095202] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.095306] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.095624] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.095910] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.110039] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 in Status: IN_PROGRESS for 2s [ 1045.265302] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66 in Status: SUCCESS [ 1045.265684] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66 deletion is rescheduled due to dependency. [ 1045.265684] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.530911] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: SUCCESS [ 1045.531202] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.125114] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 in Status: SUCCESS [ 1046.125353] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.493166] env[66502]: INFO networking_nsxv3.common.synchronization [None req-ca7d81aa-42d8-49e2-b033-a439af249743 None None] Enqueued Resource ID: ca0242f7-84ff-47f0-9798-3a9330d27d83 with Priority: HIGHEST for action port [ 1046.493166] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ca0242f7-84ff-47f0-9798-3a9330d27d83 with Priority: HIGHEST for action port [ 1046.493735] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-ca0242f7-84ff-47f0-9798-3a9330d27d83 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.493735] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ca0242f7-84ff-47f0-9798-3a9330d27d83" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.493735] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ca0242f7-84ff-47f0-9798-3a9330d27d83" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.494835] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ca0242f7-84ff-47f0-9798-3a9330d27d83" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.494835] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ca0242f7-84ff-47f0-9798-3a9330d27d83',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.532242] env[66502]: INFO networking_nsxv3.common.synchronization [req-94084e98-f629-4d6b-9707-5b58c87349a5 req-8de4e9c9-1da9-45e0-8b6c-88de90a03abc tempest-ServersTestJSON-832869893 tempest-ServersTestJSON-832869893-project-member] Enqueued Resource ID: 14ec965c-75b2-4d76-849a-5e823fe2adcd with Priority: HIGHEST for action security_group_members [ 1046.532862] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14ec965c-75b2-4d76-849a-5e823fe2adcd with Priority: HIGHEST for action security_group_members [ 1046.533213] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-14ec965c-75b2-4d76-849a-5e823fe2adcd taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.533388] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14ec965c-75b2-4d76-849a-5e823fe2adcd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.533456] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14ec965c-75b2-4d76-849a-5e823fe2adcd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.533704] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14ec965c-75b2-4d76-849a-5e823fe2adcd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.533882] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.533982] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.534053] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.534207] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.534343] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.534427] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14ec965c-75b2-4d76-849a-5e823fe2adcd',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.997439] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ca0242f7-84ff-47f0-9798-3a9330d27d83 [ 1046.998708] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.998708] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.998708] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.998937] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.998937] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.999083] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ca0242f7-84ff-47f0-9798-3a9330d27d83 already deleted. [ 1046.999144] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ca0242f7-84ff-47f0-9798-3a9330d27d83" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.038236] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.038421] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.038510] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.038781] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.038900] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.040958] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.040958] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.040958] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.040958] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.040958] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.040958] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14ec965c-75b2-4d76-849a-5e823fe2adcd is going to be updated. [ 1047.077773] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.078482] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.078482] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.078482] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.078482] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.093179] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14ec965c-75b2-4d76-849a-5e823fe2adcd in Status: IN_PROGRESS for 2s [ 1047.652977] env[66502]: INFO networking_nsxv3.common.synchronization [req-2d22d348-07b7-4e60-834e-a9ff98d562ff req-1b737437-bef0-49be-9add-4384d3e56894 tempest-AttachVolumeTestJSON-1757376105 tempest-AttachVolumeTestJSON-1757376105-project-member] Enqueued Resource ID: c04d1b14-a58f-4eee-b805-5b75e4c0afc4 with Priority: HIGHEST for action security_group_members [ 1047.653454] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c04d1b14-a58f-4eee-b805-5b75e4c0afc4 with Priority: HIGHEST for action security_group_members [ 1047.653751] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-c04d1b14-a58f-4eee-b805-5b75e4c0afc4 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.653982] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c04d1b14-a58f-4eee-b805-5b75e4c0afc4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.653982] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c04d1b14-a58f-4eee-b805-5b75e4c0afc4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.654201] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c04d1b14-a58f-4eee-b805-5b75e4c0afc4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.654356] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.654455] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.654510] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.654666] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.654754] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.654840] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c04d1b14-a58f-4eee-b805-5b75e4c0afc4',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.031693] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-775 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.031879] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-775" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.031879] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-775" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.034703] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-775" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.035054] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.035308] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.035670] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.036040] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.036249] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.036534] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1048.036686] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1048.036805] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1048.036918] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1048.037049] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1048.037157] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1048.037297] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1048.057101] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1048.057358] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1048.057635] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1048.057897] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-775" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.058353] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-367a2edf-1cc5-485d-8ca0-4472350a1e51 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.058684] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-367a2edf-1cc5-485d-8ca0-4472350a1e51" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.058874] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-367a2edf-1cc5-485d-8ca0-4472350a1e51" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.059349] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-367a2edf-1cc5-485d-8ca0-4472350a1e51" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.059559] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('367a2edf-1cc5-485d-8ca0-4472350a1e51',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.157174] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.157347] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.157414] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.157788] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.157788] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.157977] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.158602] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.158670] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.158840] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.158924] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.159290] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c04d1b14-a58f-4eee-b805-5b75e4c0afc4 already deleted. [ 1048.159438] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c04d1b14-a58f-4eee-b805-5b75e4c0afc4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.508710] env[66502]: INFO networking_nsxv3.common.synchronization [None req-0958d35a-b504-4436-b01c-a1cd2bc572c6 None None] Enqueued Resource ID: c41179ac-c915-4778-92ec-787eb9c9e03d with Priority: HIGHEST for action port [ 1048.508710] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c41179ac-c915-4778-92ec-787eb9c9e03d with Priority: HIGHEST for action port [ 1048.508710] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-c41179ac-c915-4778-92ec-787eb9c9e03d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.508710] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c41179ac-c915-4778-92ec-787eb9c9e03d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.508710] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c41179ac-c915-4778-92ec-787eb9c9e03d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.508710] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c41179ac-c915-4778-92ec-787eb9c9e03d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.508710] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c41179ac-c915-4778-92ec-787eb9c9e03d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.562708] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.563111] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.563270] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.563575] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.563731] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.563899] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port 367a2edf-1cc5-485d-8ca0-4472350a1e51 not found, creating... [ 1048.564203] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.564366] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.564482] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.564717] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.564855] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.565400] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.565400] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.565674] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.565933] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.566097] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.566248] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: 367a2edf-1cc5-485d-8ca0-4472350a1e51 is going to be created. [ 1048.591007] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.591942] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.591942] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.591942] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.591942] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.592367] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-367a2edf-1cc5-485d-8ca0-4472350a1e51" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.009652] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c41179ac-c915-4778-92ec-787eb9c9e03d [ 1049.009995] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.009995] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.010248] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.010313] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.010377] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.010530] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c41179ac-c915-4778-92ec-787eb9c9e03d already deleted. [ 1049.010530] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c41179ac-c915-4778-92ec-787eb9c9e03d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.106217] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14ec965c-75b2-4d76-849a-5e823fe2adcd in Status: SUCCESS [ 1049.106273] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14ec965c-75b2-4d76-849a-5e823fe2adcd deletion is rescheduled due to dependency. [ 1049.106409] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14ec965c-75b2-4d76-849a-5e823fe2adcd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.343817] env[66502]: INFO networking_nsxv3.common.synchronization [req-2d22d348-07b7-4e60-834e-a9ff98d562ff req-596b3449-e855-4293-9c81-7ee03f6bb386 service nova] Enqueued Resource ID: c04d1b14-a58f-4eee-b805-5b75e4c0afc4 with Priority: HIGHEST for action security_group_rules [ 1049.343817] env[66502]: INFO networking_nsxv3.common.synchronization [req-2d22d348-07b7-4e60-834e-a9ff98d562ff req-596b3449-e855-4293-9c81-7ee03f6bb386 service nova] Enqueued Resource ID: c04d1b14-a58f-4eee-b805-5b75e4c0afc4 with Priority: HIGHEST for action security_group_members [ 1049.343817] env[66502]: INFO networking_nsxv3.common.synchronization [req-2d22d348-07b7-4e60-834e-a9ff98d562ff req-596b3449-e855-4293-9c81-7ee03f6bb386 service nova] Enqueued Resource ID: 367a2edf-1cc5-485d-8ca0-4472350a1e51 with Priority: HIGHEST for action port [ 1049.344809] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c04d1b14-a58f-4eee-b805-5b75e4c0afc4 with Priority: HIGHEST for action security_group_rules [ 1049.344971] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c04d1b14-a58f-4eee-b805-5b75e4c0afc4 with Priority: HIGHEST for action security_group_members [ 1049.345082] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 367a2edf-1cc5-485d-8ca0-4472350a1e51 with Priority: HIGHEST for action port [ 1049.345403] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c04d1b14-a58f-4eee-b805-5b75e4c0afc4 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.345525] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c04d1b14-a58f-4eee-b805-5b75e4c0afc4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.345602] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c04d1b14-a58f-4eee-b805-5b75e4c0afc4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.345801] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c04d1b14-a58f-4eee-b805-5b75e4c0afc4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.345880] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c04d1b14-a58f-4eee-b805-5b75e4c0afc4',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.347251] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-c04d1b14-a58f-4eee-b805-5b75e4c0afc4 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.347359] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c04d1b14-a58f-4eee-b805-5b75e4c0afc4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.347424] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c04d1b14-a58f-4eee-b805-5b75e4c0afc4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.347624] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c04d1b14-a58f-4eee-b805-5b75e4c0afc4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.347771] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.347860] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.347919] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.348588] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.348778] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.349240] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c04d1b14-a58f-4eee-b805-5b75e4c0afc4',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.350172] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-367a2edf-1cc5-485d-8ca0-4472350a1e51 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.350420] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-367a2edf-1cc5-485d-8ca0-4472350a1e51" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.350644] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-367a2edf-1cc5-485d-8ca0-4472350a1e51" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.351123] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-367a2edf-1cc5-485d-8ca0-4472350a1e51" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.351228] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('367a2edf-1cc5-485d-8ca0-4472350a1e51',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.852821] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c04d1b14-a58f-4eee-b805-5b75e4c0afc4',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.854015] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-c04d1b14-a58f-4eee-b805-5b75e4c0afc4 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.854171] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c04d1b14-a58f-4eee-b805-5b75e4c0afc4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.854334] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 367a2edf-1cc5-485d-8ca0-4472350a1e51 with status ACTIVE [ 1049.854494] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.854592] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.854647] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.857746] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.857746] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.857746] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.857746] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.857746] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.857746] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.857746] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.857746] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.857746] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.857746] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.857746] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.857746] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.857746] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 367a2edf-1cc5-485d-8ca0-4472350a1e51 is going to be updated. [ 1049.882942] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.883192] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.883306] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.883614] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.883821] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.884162] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-367a2edf-1cc5-485d-8ca0-4472350a1e51" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.360043] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c04d1b14-a58f-4eee-b805-5b75e4c0afc4',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.866344] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.866504] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.866577] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.866801] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.866894] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.866992] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c04d1b14-a58f-4eee-b805-5b75e4c0afc4 is going to be created. [ 1050.892398] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.892582] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.892626] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.892913] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.893195] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.903287] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c04d1b14-a58f-4eee-b805-5b75e4c0afc4 in Status: UNINITIALIZED for 2s [ 1052.916848] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c04d1b14-a58f-4eee-b805-5b75e4c0afc4 in Status: SUCCESS [ 1052.917229] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c04d1b14-a58f-4eee-b805-5b75e4c0afc4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.917437] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c04d1b14-a58f-4eee-b805-5b75e4c0afc4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.917973] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c04d1b14-a58f-4eee-b805-5b75e4c0afc4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.918064] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1052.918225] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1052.918225] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1052.919174] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1052.919174] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.919174] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c04d1b14-a58f-4eee-b805-5b75e4c0afc4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1052.921827] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c04d1b14-a58f-4eee-b805-5b75e4c0afc4',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.117223] env[66502]: INFO networking_nsxv3.common.synchronization [req-4914bd59-e7aa-4b54-a15a-09aaf8ab4eb7 req-2c80b90e-88c9-4c19-9bfa-53d6ae4e3808 tempest-ServersTestJSON-1210226259 tempest-ServersTestJSON-1210226259-project-member] Enqueued Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_members [ 1053.118028] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_members [ 1053.118351] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.118568] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.118815] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.119083] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.119476] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.119649] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.119791] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.120017] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.120188] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.120331] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.427442] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c04d1b14-a58f-4eee-b805-5b75e4c0afc4',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.622813] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.930340] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c04d1b14-a58f-4eee-b805-5b75e4c0afc4: rpc.has_security_group_logging(os_id): False [ 1053.955025] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.955025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.955025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.955025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.955025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.955025] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.955025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.955025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.955025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.955025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.955025] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c04d1b14-a58f-4eee-b805-5b75e4c0afc4 is going to be created. [ 1054.039425] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.039604] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.039639] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.042135] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.042530] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.054237] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c04d1b14-a58f-4eee-b805-5b75e4c0afc4 in Status: IN_PROGRESS for 2s [ 1054.076690] env[66502]: INFO networking_nsxv3.common.synchronization [req-dc77e6c0-750f-4922-b68a-837f1dc62f2c req-1a52d947-3573-4a8e-b193-b753e4bb57ed tempest-ImagesOneServerTestJSON-1215519078 tempest-ImagesOneServerTestJSON-1215519078-project-member] Enqueued Resource ID: a469cf90-b952-424a-940b-c195857fb6f2 with Priority: HIGHEST for action security_group_members [ 1054.078947] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a469cf90-b952-424a-940b-c195857fb6f2 with Priority: HIGHEST for action security_group_members [ 1054.079775] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-a469cf90-b952-424a-940b-c195857fb6f2 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.079775] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a469cf90-b952-424a-940b-c195857fb6f2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.079775] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a469cf90-b952-424a-940b-c195857fb6f2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.080056] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a469cf90-b952-424a-940b-c195857fb6f2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.080191] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.080307] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.080370] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.080704] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.080704] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.080792] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a469cf90-b952-424a-940b-c195857fb6f2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.127422] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.557305] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-141 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.557533] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-141" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.557758] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-141" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.558107] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-141" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.558385] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.558543] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.558659] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.558891] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.559060] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.559269] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1054.559445] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1054.559487] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1054.559580] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1054.559686] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1054.559791] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1054.559920] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1054.580267] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1054.580439] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1054.581189] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1054.581189] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-141" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.581189] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-20e0dc11-b647-42cb-af75-444d28f0ecda taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.581392] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-20e0dc11-b647-42cb-af75-444d28f0ecda" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.585025] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-20e0dc11-b647-42cb-af75-444d28f0ecda" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.585025] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-20e0dc11-b647-42cb-af75-444d28f0ecda" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.585025] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20e0dc11-b647-42cb-af75-444d28f0ecda',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.585025] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.585347] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.585347] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.585434] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.585434] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.586706] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.586706] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.586706] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.586706] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.586706] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.586706] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a469cf90-b952-424a-940b-c195857fb6f2 already deleted. [ 1054.586706] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a469cf90-b952-424a-940b-c195857fb6f2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.630441] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.630627] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.630801] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.631017] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.631183] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.631310] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d226a97-2d69-4706-b98b-565700008c6f is going to be updated. [ 1054.665217] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.665360] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.665417] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.665675] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.665827] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.675186] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: IN_PROGRESS for 2s [ 1054.989262] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.989262] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.989262] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.989262] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.989262] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.086497] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.086497] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.086758] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.087151] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.087151] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.087270] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 20e0dc11-b647-42cb-af75-444d28f0ecda not found, creating... [ 1055.087902] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.087902] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.087902] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.088292] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.088292] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.089304] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.089304] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.089304] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.089671] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.089671] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.090231] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 20e0dc11-b647-42cb-af75-444d28f0ecda is going to be created. [ 1055.119648] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.119794] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.119917] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.120356] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.120435] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.120653] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-20e0dc11-b647-42cb-af75-444d28f0ecda" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.491741] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.830640] env[66502]: INFO networking_nsxv3.common.synchronization [req-0e4d71dd-7026-4e57-8950-a5e09a5f9f2f req-2a05cb00-9027-4947-a3ff-99debbe6a0e3 tempest-FloatingIPsAssociationNegativeTestJSON-1645844367 tempest-FloatingIPsAssociationNegativeTestJSON-1645844367-project-member] Enqueued Resource ID: c6a88e37-d54b-42a9-b5c6-a059d6ab069a with Priority: HIGHEST for action security_group_members [ 1055.830943] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c6a88e37-d54b-42a9-b5c6-a059d6ab069a with Priority: HIGHEST for action security_group_members [ 1055.831305] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-c6a88e37-d54b-42a9-b5c6-a059d6ab069a taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.831433] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c6a88e37-d54b-42a9-b5c6-a059d6ab069a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.831525] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c6a88e37-d54b-42a9-b5c6-a059d6ab069a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.831818] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c6a88e37-d54b-42a9-b5c6-a059d6ab069a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.832034] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.832180] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.832251] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.832449] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.832554] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.832670] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c6a88e37-d54b-42a9-b5c6-a059d6ab069a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.843115] env[66502]: INFO networking_nsxv3.common.synchronization [req-dc77e6c0-750f-4922-b68a-837f1dc62f2c req-9c105c14-3a4c-4ec4-90fa-442f5dc4a7db service nova] Enqueued Resource ID: a469cf90-b952-424a-940b-c195857fb6f2 with Priority: HIGHEST for action security_group_rules [ 1055.843356] env[66502]: INFO networking_nsxv3.common.synchronization [req-dc77e6c0-750f-4922-b68a-837f1dc62f2c req-9c105c14-3a4c-4ec4-90fa-442f5dc4a7db service nova] Enqueued Resource ID: a469cf90-b952-424a-940b-c195857fb6f2 with Priority: HIGHEST for action security_group_members [ 1055.843573] env[66502]: INFO networking_nsxv3.common.synchronization [req-dc77e6c0-750f-4922-b68a-837f1dc62f2c req-9c105c14-3a4c-4ec4-90fa-442f5dc4a7db service nova] Enqueued Resource ID: 20e0dc11-b647-42cb-af75-444d28f0ecda with Priority: HIGHEST for action port [ 1055.844664] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a469cf90-b952-424a-940b-c195857fb6f2 with Priority: HIGHEST for action security_group_rules [ 1055.845604] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a469cf90-b952-424a-940b-c195857fb6f2 with Priority: HIGHEST for action security_group_members [ 1055.845604] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20e0dc11-b647-42cb-af75-444d28f0ecda with Priority: HIGHEST for action port [ 1055.845800] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a469cf90-b952-424a-940b-c195857fb6f2 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.846201] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a469cf90-b952-424a-940b-c195857fb6f2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.846333] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a469cf90-b952-424a-940b-c195857fb6f2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.846700] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a469cf90-b952-424a-940b-c195857fb6f2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.846899] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a469cf90-b952-424a-940b-c195857fb6f2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.848099] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-a469cf90-b952-424a-940b-c195857fb6f2 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.848267] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a469cf90-b952-424a-940b-c195857fb6f2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.848312] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a469cf90-b952-424a-940b-c195857fb6f2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.848555] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a469cf90-b952-424a-940b-c195857fb6f2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.848856] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.849022] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.849099] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.849349] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.849505] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.849649] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a469cf90-b952-424a-940b-c195857fb6f2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.850783] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-20e0dc11-b647-42cb-af75-444d28f0ecda taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.850940] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20e0dc11-b647-42cb-af75-444d28f0ecda" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.852225] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20e0dc11-b647-42cb-af75-444d28f0ecda" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.853502] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20e0dc11-b647-42cb-af75-444d28f0ecda" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.853502] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20e0dc11-b647-42cb-af75-444d28f0ecda',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.994236] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.067854] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c04d1b14-a58f-4eee-b805-5b75e4c0afc4 in Status: SUCCESS [ 1056.068435] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c04d1b14-a58f-4eee-b805-5b75e4c0afc4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.335034] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.335145] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.335181] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.335497] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.335497] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.335693] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.335790] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.335849] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.336009] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.336089] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.336177] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6a88e37-d54b-42a9-b5c6-a059d6ab069a is going to be updated. [ 1056.357658] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a469cf90-b952-424a-940b-c195857fb6f2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.358785] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-a469cf90-b952-424a-940b-c195857fb6f2 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.358911] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a469cf90-b952-424a-940b-c195857fb6f2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.363300] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 20e0dc11-b647-42cb-af75-444d28f0ecda with status ACTIVE [ 1056.364629] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.364629] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.364629] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.364629] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.364629] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.364629] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.364629] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.364629] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.364629] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.365278] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.365278] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.365278] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.365278] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.365278] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.365278] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.365278] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 20e0dc11-b647-42cb-af75-444d28f0ecda is going to be updated. [ 1056.372385] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.372531] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.372597] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.372788] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.372942] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.381556] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6a88e37-d54b-42a9-b5c6-a059d6ab069a in Status: IN_PROGRESS for 2s [ 1056.388254] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.388425] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.388486] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.388692] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.388845] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.389015] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20e0dc11-b647-42cb-af75-444d28f0ecda" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.496544] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1056.496690] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1056.502567] env[66502]: INFO networking_nsxv3.common.synchronization [req-032ebbfe-428c-47d9-80c9-f383467bae94 req-24faa62b-5261-44f8-98bd-f248c81ff3d2 tempest-DeleteServersTestJSON-51385704 tempest-DeleteServersTestJSON-51385704-project-member] Enqueued Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_members [ 1056.503353] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_members [ 1056.503553] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-704e5eab-aa44-4493-8c9a-0b24250e7bea taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.503672] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.503725] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.503939] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.504111] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.504224] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.504284] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.504412] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.504494] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.504590] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.688741] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: SUCCESS [ 1056.690106] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.850686] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-608 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.850874] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-608" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.850998] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-608" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.851301] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-608" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.851553] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.851707] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.851821] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.852126] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.852291] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.852497] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1056.852671] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1056.852715] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1056.852812] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1056.852918] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1056.853031] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1056.853161] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1056.859660] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a469cf90-b952-424a-940b-c195857fb6f2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.888430] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1056.888430] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.035 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1056.888430] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1056.888430] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-608" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.888762] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-78a01644-1a21-4a79-8535-ca6632b89606 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.888932] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-78a01644-1a21-4a79-8535-ca6632b89606" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.889085] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-78a01644-1a21-4a79-8535-ca6632b89606" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.889713] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-78a01644-1a21-4a79-8535-ca6632b89606" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.889713] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78a01644-1a21-4a79-8535-ca6632b89606',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.009083] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.009083] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.009083] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.009083] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.009083] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.009083] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.009083] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.009083] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.009083] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.009083] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.009083] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea is going to be updated. [ 1057.057237] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.057400] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.057400] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.057624] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.057796] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.070934] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: IN_PROGRESS for 2s [ 1057.362562] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.362800] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.362930] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.363278] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.363433] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.363599] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a469cf90-b952-424a-940b-c195857fb6f2 is going to be created. [ 1057.393886] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.394122] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.394249] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.394549] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.394690] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.394846] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 78a01644-1a21-4a79-8535-ca6632b89606 not found, creating... [ 1057.395197] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.395283] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.395399] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.395690] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.395842] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.396175] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.396357] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.396490] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.396681] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.396815] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.396952] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 78a01644-1a21-4a79-8535-ca6632b89606 is going to be created. [ 1057.398863] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.399147] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.399147] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.399272] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.399340] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.409743] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.409913] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.409948] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.410148] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.422774] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1057.423728] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.424913] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1057.428455] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a469cf90-b952-424a-940b-c195857fb6f2 in Status: UNINITIALIZED for 2s [ 1057.461438] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.461628] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.461628] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.461894] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.462146] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.462381] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-78a01644-1a21-4a79-8535-ca6632b89606" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.473734] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.473883] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.473955] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.474191] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.484246] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.485144] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1057.485232] env[66502]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66502) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1057.485325] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1057.533763] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.533946] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.533981] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.534201] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.535540] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.535854] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1057.665230] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.665462] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.665462] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.665679] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.665970] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.666254] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1057.748951] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.749132] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.749210] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.749413] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.749681] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.749942] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:40. [ 1057.750054] env[66502]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'ee2e9577-19ff-440d-9bd8-24dbaf88ea24', '9d226a97-2d69-4706-b98b-565700008c6f', '6768b7ab-f09a-42ec-87a9-9546009ee043', '5988a824-4ff2-477d-8139-5418f9c569e4', 'cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66', 'c7d21481-83aa-4bac-bea4-1030ed0a857b', 'ddb3b9a8-c63d-4123-aa7f-cbf2b5279231', '4eb2d9d2-95c1-4cee-98cc-8a9106959838', '8ab1d50c-f5a6-4aaf-829b-d0cfdf164722', 'aba51398-48dc-4f5e-b3cf-1da4130d58fb', '9e5c2909-7671-4f4c-995e-cc0f19e2e48d', '05164d98-30c1-459b-9f4c-ac294382c57e', '14ec965c-75b2-4d76-849a-5e823fe2adcd', 'dc23d7c3-5dc4-486e-83b2-d32fa7298233', '14691ab9-6ef7-4499-a5c8-0c1a0b5a8191', '2b94d044-5ce0-4270-aced-c26d396494bc', 'fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5', '38951171-ba5a-4a21-9804-7356a9fd37d5', '67c97dc5-9d08-4219-aa00-0b83a223ae57', 'b4dfff3d-ef74-48f2-8955-b975cccf84d9', '9ee12fee-49b0-4d1d-b52d-29888a355e8a', 'e12852c1-7dc2-4ed2-bd34-e396f9f9256d', '6a050294-bf61-423f-b50c-cccbf8fa309f', 'ee8e701d-05aa-43ae-8307-095303edba0f', '4dd503d7-4db7-4af2-b850-79a736ef1ddc', '0204e1c6-c967-43a4-828f-5c28ecb8f527', 'c6a88e37-d54b-42a9-b5c6-a059d6ab069a', 'c04d1b14-a58f-4eee-b805-5b75e4c0afc4', 'b96da033-21f1-44bb-a822-a4cb59139771', '704e5eab-aa44-4493-8c9a-0b24250e7bea', '670eb61a-b688-45b2-9400-64232c7b8af0', '0bae9bdb-dcb4-4110-bcb0-1b0548a94738', '145e088c-6cef-4e3b-8451-5f708e7f0412', '881e7189-5d27-4efb-b9a3-71f2b26c3add', '4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f', '7421254e-fac2-4232-97e1-1f7373688543', 'f33bcef8-0b06-4301-b08b-ba4a7cd9e47a', 'eeb100e3-e5a7-4d38-a030-42278dbe1366', 'b10a43dc-2d28-4687-a424-05a1ebdfa3c3', '6de9830d-7ae4-42f4-8f89-7bd0093a3ef2'} {{(pid=66502) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1057.750177] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1057.771166] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.771348] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.771413] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.771582] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.771791] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.771791] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1057.771936] env[66502]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66502) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1057.771936] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1057.905503] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.905648] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.905753] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.905988] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.907517] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.907955] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1057.908136] env[66502]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66502) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1057.908136] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1057.908206] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1057.908274] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/40 resources of Type:Security Group Rules [ 1057.908373] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 with Priority: HIGH for action security_group_rules [ 1057.908503] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGH for action security_group_rules [ 1057.908657] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6768b7ab-f09a-42ec-87a9-9546009ee043 with Priority: HIGH for action security_group_rules [ 1057.908657] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5988a824-4ff2-477d-8139-5418f9c569e4 with Priority: HIGH for action security_group_rules [ 1057.908710] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66 with Priority: HIGH for action security_group_rules [ 1057.908970] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c7d21481-83aa-4bac-bea4-1030ed0a857b with Priority: HIGH for action security_group_rules [ 1057.908970] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 with Priority: HIGH for action security_group_rules [ 1057.908970] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 with Priority: HIGH for action security_group_rules [ 1057.908970] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 with Priority: HIGH for action security_group_rules [ 1057.909130] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGH for action security_group_rules [ 1057.909130] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d with Priority: HIGH for action security_group_rules [ 1057.909130] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 05164d98-30c1-459b-9f4c-ac294382c57e with Priority: HIGH for action security_group_rules [ 1057.909225] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 14ec965c-75b2-4d76-849a-5e823fe2adcd with Priority: HIGH for action security_group_rules [ 1057.909255] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dc23d7c3-5dc4-486e-83b2-d32fa7298233 with Priority: HIGH for action security_group_rules [ 1057.909307] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 with Priority: HIGH for action security_group_rules [ 1057.909365] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2b94d044-5ce0-4270-aced-c26d396494bc with Priority: HIGH for action security_group_rules [ 1057.909425] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5 with Priority: HIGH for action security_group_rules [ 1057.909484] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 38951171-ba5a-4a21-9804-7356a9fd37d5 with Priority: HIGH for action security_group_rules [ 1057.909543] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 with Priority: HIGH for action security_group_rules [ 1057.909615] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b4dfff3d-ef74-48f2-8955-b975cccf84d9 with Priority: HIGH for action security_group_rules [ 1057.909705] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.132078] env[66502]: INFO networking_nsxv3.common.synchronization [req-032ebbfe-428c-47d9-80c9-f383467bae94 req-d4f1fcc0-8ab2-4745-a5be-600432725578 service nova] Enqueued Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_rules [ 1058.132337] env[66502]: INFO networking_nsxv3.common.synchronization [req-032ebbfe-428c-47d9-80c9-f383467bae94 req-d4f1fcc0-8ab2-4745-a5be-600432725578 service nova] Enqueued Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_members [ 1058.132416] env[66502]: INFO networking_nsxv3.common.synchronization [req-032ebbfe-428c-47d9-80c9-f383467bae94 req-d4f1fcc0-8ab2-4745-a5be-600432725578 service nova] Enqueued Resource ID: 78a01644-1a21-4a79-8535-ca6632b89606 with Priority: HIGHEST for action port [ 1058.133021] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_rules [ 1058.133179] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_members [ 1058.133280] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78a01644-1a21-4a79-8535-ca6632b89606 with Priority: HIGHEST for action port [ 1058.133374] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 with Priority: HIGH for action security_group_rules [ 1058.133467] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6768b7ab-f09a-42ec-87a9-9546009ee043 with Priority: HIGH for action security_group_rules [ 1058.133556] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 with Priority: HIGH for action security_group_rules [ 1058.133649] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 with Priority: HIGH for action security_group_rules [ 1058.133783] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4dfff3d-ef74-48f2-8955-b975cccf84d9 with Priority: HIGH for action security_group_rules [ 1058.134086] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 with Priority: HIGH for action security_group_rules [ 1058.134086] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38951171-ba5a-4a21-9804-7356a9fd37d5 with Priority: HIGH for action security_group_rules [ 1058.134086] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5 with Priority: HIGH for action security_group_rules [ 1058.134212] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc23d7c3-5dc4-486e-83b2-d32fa7298233 with Priority: HIGH for action security_group_rules [ 1058.134212] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b94d044-5ce0-4270-aced-c26d396494bc with Priority: HIGH for action security_group_rules [ 1058.135077] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14ec965c-75b2-4d76-849a-5e823fe2adcd with Priority: HIGH for action security_group_rules [ 1058.135077] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 05164d98-30c1-459b-9f4c-ac294382c57e with Priority: HIGH for action security_group_rules [ 1058.135077] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d with Priority: HIGH for action security_group_rules [ 1058.135077] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGH for action security_group_rules [ 1058.135077] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 with Priority: HIGH for action security_group_rules [ 1058.135300] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c7d21481-83aa-4bac-bea4-1030ed0a857b with Priority: HIGH for action security_group_rules [ 1058.135882] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 with Priority: HIGH for action security_group_rules [ 1058.135882] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66 with Priority: HIGH for action security_group_rules [ 1058.135882] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGH for action security_group_rules [ 1058.135882] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5988a824-4ff2-477d-8139-5418f9c569e4 with Priority: HIGH for action security_group_rules [ 1058.136272] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-704e5eab-aa44-4493-8c9a-0b24250e7bea taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.136391] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.136642] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.136727] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.136727] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.137965] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-704e5eab-aa44-4493-8c9a-0b24250e7bea taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.138083] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.139071] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-78a01644-1a21-4a79-8535-ca6632b89606 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.139071] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78a01644-1a21-4a79-8535-ca6632b89606" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.139071] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78a01644-1a21-4a79-8535-ca6632b89606" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.139071] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78a01644-1a21-4a79-8535-ca6632b89606" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.139071] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78a01644-1a21-4a79-8535-ca6632b89606',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.139547] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee2e9577-19ff-440d-9bd8-24dbaf88ea24 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.140029] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.140154] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.140331] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.143441] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee2e9577-19ff-440d-9bd8-24dbaf88ea24',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.143788] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6768b7ab-f09a-42ec-87a9-9546009ee043 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.143901] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6768b7ab-f09a-42ec-87a9-9546009ee043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.143964] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6768b7ab-f09a-42ec-87a9-9546009ee043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.144145] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6768b7ab-f09a-42ec-87a9-9546009ee043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.144217] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6768b7ab-f09a-42ec-87a9-9546009ee043',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.145169] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.145273] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.145338] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.146144] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.146144] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ddb3b9a8-c63d-4123-aa7f-cbf2b5279231',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.146357] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.146482] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.146544] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.146672] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.146773] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14691ab9-6ef7-4499-a5c8-0c1a0b5a8191',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.148636] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b4dfff3d-ef74-48f2-8955-b975cccf84d9 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.148752] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.148820] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.152392] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.152392] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b4dfff3d-ef74-48f2-8955-b975cccf84d9',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.152392] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-67c97dc5-9d08-4219-aa00-0b83a223ae57 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.152392] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.152392] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.152392] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.152392] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('67c97dc5-9d08-4219-aa00-0b83a223ae57',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.156457] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-38951171-ba5a-4a21-9804-7356a9fd37d5 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.156608] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-38951171-ba5a-4a21-9804-7356a9fd37d5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.156654] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-38951171-ba5a-4a21-9804-7356a9fd37d5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.156831] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-38951171-ba5a-4a21-9804-7356a9fd37d5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.156907] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('38951171-ba5a-4a21-9804-7356a9fd37d5',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.157701] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.157851] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.157940] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.159171] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.159284] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.163685] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-dc23d7c3-5dc4-486e-83b2-d32fa7298233 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.163685] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-dc23d7c3-5dc4-486e-83b2-d32fa7298233" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.163685] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-dc23d7c3-5dc4-486e-83b2-d32fa7298233" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.163685] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-dc23d7c3-5dc4-486e-83b2-d32fa7298233" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.163685] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('dc23d7c3-5dc4-486e-83b2-d32fa7298233',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.163685] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b94d044-5ce0-4270-aced-c26d396494bc taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.163685] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b94d044-5ce0-4270-aced-c26d396494bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.163685] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b94d044-5ce0-4270-aced-c26d396494bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.163685] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b94d044-5ce0-4270-aced-c26d396494bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.163685] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b94d044-5ce0-4270-aced-c26d396494bc',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.164254] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14ec965c-75b2-4d76-849a-5e823fe2adcd taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.164254] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14ec965c-75b2-4d76-849a-5e823fe2adcd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.164254] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14ec965c-75b2-4d76-849a-5e823fe2adcd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.164345] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14ec965c-75b2-4d76-849a-5e823fe2adcd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.164372] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14ec965c-75b2-4d76-849a-5e823fe2adcd',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.165878] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-05164d98-30c1-459b-9f4c-ac294382c57e taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.166044] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-05164d98-30c1-459b-9f4c-ac294382c57e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.166122] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-05164d98-30c1-459b-9f4c-ac294382c57e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.167335] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-05164d98-30c1-459b-9f4c-ac294382c57e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.167948] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('05164d98-30c1-459b-9f4c-ac294382c57e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.169846] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9e5c2909-7671-4f4c-995e-cc0f19e2e48d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.169971] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.170077] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.170275] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.170384] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9e5c2909-7671-4f4c-995e-cc0f19e2e48d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.171344] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aba51398-48dc-4f5e-b3cf-1da4130d58fb taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.172382] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.172606] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.172679] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.173100] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.173612] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.173773] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.173914] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.174059] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.174163] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ab1d50c-f5a6-4aaf-829b-d0cfdf164722',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.175204] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c7d21481-83aa-4bac-bea4-1030ed0a857b taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.176101] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c7d21481-83aa-4bac-bea4-1030ed0a857b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.176243] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c7d21481-83aa-4bac-bea4-1030ed0a857b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.176596] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c7d21481-83aa-4bac-bea4-1030ed0a857b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.176738] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c7d21481-83aa-4bac-bea4-1030ed0a857b',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.177588] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4eb2d9d2-95c1-4cee-98cc-8a9106959838 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.177797] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.178130] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.178130] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.178356] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4eb2d9d2-95c1-4cee-98cc-8a9106959838',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.179145] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.179452] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.179452] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.179589] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.179647] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.180365] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.180517] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.180632] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.180770] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.180863] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.183092] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5988a824-4ff2-477d-8139-5418f9c569e4 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.183263] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5988a824-4ff2-477d-8139-5418f9c569e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.183366] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5988a824-4ff2-477d-8139-5418f9c569e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.183681] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5988a824-4ff2-477d-8139-5418f9c569e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.183681] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5988a824-4ff2-477d-8139-5418f9c569e4',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.394993] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c6a88e37-d54b-42a9-b5c6-a059d6ab069a in Status: SUCCESS [ 1058.394993] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c6a88e37-d54b-42a9-b5c6-a059d6ab069a deletion is rescheduled due to dependency. [ 1058.394993] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c6a88e37-d54b-42a9-b5c6-a059d6ab069a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.687842] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb2d9d2-95c1-4cee-98cc-8a9106959838 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.687842] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.687842] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.687842] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.687842] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.687842] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.687842] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.687842] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.687842] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.687842] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.687842] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4eb2d9d2-95c1-4cee-98cc-8a9106959838',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.688926] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6768b7ab-f09a-42ec-87a9-9546009ee043 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.689286] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6768b7ab-f09a-42ec-87a9-9546009ee043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.689481] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6768b7ab-f09a-42ec-87a9-9546009ee043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.689742] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6768b7ab-f09a-42ec-87a9-9546009ee043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.692019] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.692019] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.692019] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.692019] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.692019] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.692019] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6768b7ab-f09a-42ec-87a9-9546009ee043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.692019] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6768b7ab-f09a-42ec-87a9-9546009ee043',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.694924] env[66502]: INFO networking_nsxv3.common.synchronization [None req-eb6b2c15-a4ee-4cf7-8795-2647af65fafc None None] Enqueued Resource ID: e868b3e2-9b3d-4d71-9403-7c6ed3b39325 with Priority: HIGHEST for action port [ 1058.697671] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-704e5eab-aa44-4493-8c9a-0b24250e7bea taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.697958] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.698236] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 78a01644-1a21-4a79-8535-ca6632b89606 with status ACTIVE [ 1058.698501] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.698725] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.699326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.699326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.699326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.699326] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port 78a01644-1a21-4a79-8535-ca6632b89606 not found, creating... [ 1058.699480] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.699524] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.699614] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.699779] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.699882] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.700177] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.700177] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.700291] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.700442] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.700537] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.700641] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 78a01644-1a21-4a79-8535-ca6632b89606 is going to be created. [ 1058.704254] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-aba51398-48dc-4f5e-b3cf-1da4130d58fb taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.704723] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.704723] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.704723] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.704723] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.704955] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.704991] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.705181] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.705255] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.705358] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.705540] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.707535] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.707704] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.707704] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.707940] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.708181] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.708301] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.708875] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.708875] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.708875] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.708875] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.709704] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8ab1d50c-f5a6-4aaf-829b-d0cfdf164722',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.710036] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.710252] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.710307] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.710529] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.710615] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.710712] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.710789] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.711103] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.711103] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.711103] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.711344] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('14691ab9-6ef7-4499-a5c8-0c1a0b5a8191',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.716344] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e868b3e2-9b3d-4d71-9403-7c6ed3b39325 with Priority: HIGHEST for action port [ 1058.725434] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.725637] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.725714] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.726064] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.726279] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.726411] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.726493] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.726667] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.726790] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.728218] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.728218] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.728218] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-5988a824-4ff2-477d-8139-5418f9c569e4 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.728377] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5988a824-4ff2-477d-8139-5418f9c569e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.728460] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5988a824-4ff2-477d-8139-5418f9c569e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.728654] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5988a824-4ff2-477d-8139-5418f9c569e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.728827] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.728981] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.729175] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.729277] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.729348] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.729448] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5988a824-4ff2-477d-8139-5418f9c569e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.729546] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5988a824-4ff2-477d-8139-5418f9c569e4',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.732557] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-e868b3e2-9b3d-4d71-9403-7c6ed3b39325 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.732557] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e868b3e2-9b3d-4d71-9403-7c6ed3b39325" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.732557] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e868b3e2-9b3d-4d71-9403-7c6ed3b39325" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.732557] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e868b3e2-9b3d-4d71-9403-7c6ed3b39325" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.732557] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e868b3e2-9b3d-4d71-9403-7c6ed3b39325',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1058.784145] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.784372] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.784432] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.784622] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.787164] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.787473] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.788325] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.788455] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.789162] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.789457] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.790255] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.790355] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.791311] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.791311] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.791955] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.792062] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.793427] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.793530] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.794755] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.794755] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.795656] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.795752] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.796577] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.796577] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.798661] env[66502]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1058.798661] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.798661] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.798661] env[66502]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1058.799138] env[66502]: ERROR networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Request=Function PUT Argumetns {'path': '/policy/api/v1/infra/segments/nsx-vlan-transportzone-608/ports/78a01644-1a21-4a79-8535-ca6632b89606', 'data': {'id': '78a01644-1a21-4a79-8535-ca6632b89606', 'display_name': '78a01644-1a21-4a79-8535-ca6632b89606', 'resource_type': 'SegmentPort', 'admin_state': 'UP', 'attachment': {'id': '78a01644-1a21-4a79-8535-ca6632b89606', 'type': 'PARENT', 'traffic_tag': 608}, 'address_bindings': [{'ip_address': '192.168.128.6', 'mac_address': 'fa:16:3e:ab:99:36'}], 'tags': [{'scope': 'age', 'tag': 1763692043}, {'scope': 'revision_number', 'tag': 5}, {'scope': 'security_group', 'tag': '704e5eab-aa44-4493-8c9a-0b24250e7bea'}], 'parent_path': '/infra/segments/nsx-vlan-transportzone-608', 'path': '/infra/segments/nsx-vlan-transportzone-608/ports/78a01644-1a21-4a79-8535-ca6632b89606', '_revision': None}} Response=Error Code=400 Message=b'{\n "httpStatus" : "BAD_REQUEST",\n "error_code" : 500127,\n "module_name" : "Policy",\n "error_message" : "Cannot create an object with path=[/infra/segments/nsx-vlan-transportzone-608/ports/78a01644-1a21-4a79-8535-ca6632b89606] as it already exists."\n}' [ 1058.799202] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78a01644-1a21-4a79-8535-ca6632b89606" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.799367] env[66502]: Traceback (most recent call last): [ 1058.799367] env[66502]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 1058.799367] env[66502]: listener.cb(fileno) [ 1058.799367] env[66502]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 1058.799367] env[66502]: result = function(*args, **kwargs) [ 1058.799367] env[66502]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 270, in port [ 1058.799367] env[66502]: self._port_realize(port) [ 1058.799367] env[66502]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 368, in _port_realize [ 1058.799367] env[66502]: return self.nsx_provider.port_realize(os_port, delete) [ 1058.799367] env[66502]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 969, in port_realize [ 1058.799367] env[66502]: return self._realize(Provider.PORT, False, self.payload.segment_port, os_port, provider_port) [ 1058.799367] env[66502]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 1058.799367] env[66502]: return func(*args, **kwargs) [ 1058.799367] env[66502]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 785, in _realize [ 1058.799367] env[66502]: res = self.client.put(path=path, data=data) [ 1058.799367] env[66502]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/client_nsx.py", line 125, in decorator [ 1058.799367] env[66502]: raise RuntimeError(msg, last_err) [ 1058.799367] env[66502]: RuntimeError: (None, 'Error Code=400 Message=b\'{\\n "httpStatus" : "BAD_REQUEST",\\n "error_code" : 500127,\\n "module_name" : "Policy",\\n "error_message" : "Cannot create an object with path=[/infra/segments/nsx-vlan-transportzone-608/ports/78a01644-1a21-4a79-8535-ca6632b89606] as it already exists."\\n}\'') [ 1058.799367] env[66502]: Removing descriptor: 31 [ 1058.800384] env[66502]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1058.800384] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.800452] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.814393] env[66502]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1058.814924] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.815065] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 38951171-ba5a-4a21-9804-7356a9fd37d5 is going to be deleted. [ 1058.815993] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.816247] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.839512] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.839683] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9e5c2909-7671-4f4c-995e-cc0f19e2e48d is going to be deleted. [ 1058.840790] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.840790] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.867212] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.867390] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c7d21481-83aa-4bac-bea4-1030ed0a857b is going to be deleted. [ 1058.868959] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.869404] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.904525] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.904831] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.908290] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.908415] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.912260] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.912723] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b4dfff3d-ef74-48f2-8955-b975cccf84d9 is going to be deleted. [ 1058.914272] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.914450] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.937519] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.937809] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.945721] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.945897] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 05164d98-30c1-459b-9f4c-ac294382c57e is going to be deleted. [ 1058.946854] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.947104] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.989589] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.989589] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5 is going to be deleted. [ 1058.990842] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.990954] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.015498] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.016557] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.047755] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.047755] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66 is going to be deleted. [ 1059.048131] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.049030] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.092429] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: SUCCESS [ 1059.092616] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea deletion is rescheduled due to dependency. [ 1059.092737] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.092912] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.093330] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.093625] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.093875] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.093970] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.094201] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.094383] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.094490] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.106952] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.107368] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.114365] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.114365] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ddb3b9a8-c63d-4123-aa7f-cbf2b5279231 is going to be deleted. [ 1059.115842] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.115925] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.165906] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.166257] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14ec965c-75b2-4d76-849a-5e823fe2adcd is going to be deleted. [ 1059.167454] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.167703] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.196123] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb2d9d2-95c1-4cee-98cc-8a9106959838 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.196438] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.196438] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.196673] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.196864] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.196944] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.197023] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.197187] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.197407] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.197407] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.197653] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb2d9d2-95c1-4cee-98cc-8a9106959838 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.197868] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.197868] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.198141] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.198390] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.198505] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.198579] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.198882] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.199288] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.199288] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.199398] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4eb2d9d2-95c1-4cee-98cc-8a9106959838',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.200914] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6768b7ab-f09a-42ec-87a9-9546009ee043',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.206071] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.206071] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.207656] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.208094] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 67c97dc5-9d08-4219-aa00-0b83a223ae57 is going to be deleted. [ 1059.209745] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.210506] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.217821] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-aba51398-48dc-4f5e-b3cf-1da4130d58fb taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.217821] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.217938] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.218089] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.218282] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.218390] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.218462] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.218700] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.218861] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.219271] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.219383] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-aba51398-48dc-4f5e-b3cf-1da4130d58fb taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.219469] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.219591] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.219891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.220157] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.220308] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.220308] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.220509] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.220612] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.220729] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.220832] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.222323] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('14691ab9-6ef7-4499-a5c8-0c1a0b5a8191',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.223441] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8ab1d50c-f5a6-4aaf-829b-d0cfdf164722',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.237709] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.237967] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.238041] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.238279] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.238472] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.239072] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.239072] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.239306] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.239406] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.239512] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.239678] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.239776] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.239840] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.240012] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.240179] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.240322] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.240322] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.240458] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.240556] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.240657] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.240720] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.241645] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5988a824-4ff2-477d-8139-5418f9c569e4',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.243349] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e868b3e2-9b3d-4d71-9403-7c6ed3b39325 [ 1059.243635] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.243765] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.243807] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.243960] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.244966] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.245152] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e868b3e2-9b3d-4d71-9403-7c6ed3b39325 already deleted. [ 1059.245424] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e868b3e2-9b3d-4d71-9403-7c6ed3b39325" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.267421] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.267570] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee2e9577-19ff-440d-9bd8-24dbaf88ea24 is going to be deleted. [ 1059.268900] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.269095] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.308953] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.309895] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.348925] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.349274] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: dc23d7c3-5dc4-486e-83b2-d32fa7298233 is going to be deleted. [ 1059.351247] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.352059] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.366031] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.366344] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.388058] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.388254] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.389829] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.389993] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.430454] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.430454] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b94d044-5ce0-4270-aced-c26d396494bc is going to be deleted. [ 1059.435620] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.436040] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.436314] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.436314] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-38951171-ba5a-4a21-9804-7356a9fd37d5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.438741] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.439563] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.439563] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.439563] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9e5c2909-7671-4f4c-995e-cc0f19e2e48d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.440605] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.440699] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.440759] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.440950] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.441052] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.441176] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-67c97dc5-9d08-4219-aa00-0b83a223ae57" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.441881] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.441881] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.441987] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.442203] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c7d21481-83aa-4bac-bea4-1030ed0a857b" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.442362] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.442517] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.442596] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.442712] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b4dfff3d-ef74-48f2-8955-b975cccf84d9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.442852] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.443161] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.443161] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.443286] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-05164d98-30c1-459b-9f4c-ac294382c57e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.443328] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.443443] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.443586] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.443700] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fe90d57d-37d9-4dc3-8d85-9b53ecf6bbb5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.443828] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.443970] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.444072] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.444209] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cbab6e3a-14e0-4ebd-9fc1-cd9fd2ef1f66" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.444363] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.444511] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.444585] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.444936] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ddb3b9a8-c63d-4123-aa7f-cbf2b5279231" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.444936] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.444936] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.445055] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.445183] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee2e9577-19ff-440d-9bd8-24dbaf88ea24" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.445326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.445471] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.445544] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.445653] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14ec965c-75b2-4d76-849a-5e823fe2adcd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.490185] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a469cf90-b952-424a-940b-c195857fb6f2 in Status: SUCCESS [ 1059.490412] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a469cf90-b952-424a-940b-c195857fb6f2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.494021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a469cf90-b952-424a-940b-c195857fb6f2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.494021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a469cf90-b952-424a-940b-c195857fb6f2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.494021] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.494021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.494021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.494021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.494021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.494021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a469cf90-b952-424a-940b-c195857fb6f2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.494021] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a469cf90-b952-424a-940b-c195857fb6f2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.531283] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.531566] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.531673] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.532045] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.532361] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.532649] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-dc23d7c3-5dc4-486e-83b2-d32fa7298233" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.598424] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.703268] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6768b7ab-f09a-42ec-87a9-9546009ee043: rpc.has_security_group_logging(os_id): False [ 1059.704365] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4eb2d9d2-95c1-4cee-98cc-8a9106959838: rpc.has_security_group_logging(os_id): False [ 1059.726262] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aba51398-48dc-4f5e-b3cf-1da4130d58fb: rpc.has_security_group_logging(os_id): False [ 1059.726262] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191: rpc.has_security_group_logging(os_id): False [ 1059.733328] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722: rpc.has_security_group_logging(os_id): False [ 1059.746306] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9d226a97-2d69-4706-b98b-565700008c6f: rpc.has_security_group_logging(os_id): False [ 1059.747511] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5988a824-4ff2-477d-8139-5418f9c569e4: rpc.has_security_group_logging(os_id): False [ 1059.774599] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.774599] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.774599] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.774599] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.779679] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.779679] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.780535] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.780535] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.781306] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.781438] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.790292] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.790412] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.800317] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.800317] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.830398] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.830600] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.841914] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.842092] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.852112] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.852112] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.852112] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.852112] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.852112] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.852112] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.852112] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.852112] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.852112] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.852112] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.852112] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.852875] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.852875] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.852875] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.852875] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.852875] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.852875] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 is going to be updated. [ 1059.854370] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.854545] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.878564] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.878900] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.878993] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.879069] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.879291] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.879397] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.879466] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 is going to be updated. [ 1059.880626] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.880858] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.939498] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.939815] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.939947] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.939975] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.940198] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.940280] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.940377] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6768b7ab-f09a-42ec-87a9-9546009ee043 is going to be updated. [ 1059.941501] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.941642] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.962695] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.962854] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.970248] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.970590] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.970695] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.970746] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.970955] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.971054] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.971147] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 is going to be updated. [ 1059.972312] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.972497] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.993714] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.993924] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.994320] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-a469cf90-b952-424a-940b-c195857fb6f2 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.994457] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a469cf90-b952-424a-940b-c195857fb6f2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.994539] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a469cf90-b952-424a-940b-c195857fb6f2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.995376] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a469cf90-b952-424a-940b-c195857fb6f2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.995600] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.995692] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.995869] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.996104] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.996193] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.996284] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a469cf90-b952-424a-940b-c195857fb6f2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.996443] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-a469cf90-b952-424a-940b-c195857fb6f2 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.996535] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a469cf90-b952-424a-940b-c195857fb6f2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.996594] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a469cf90-b952-424a-940b-c195857fb6f2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.996736] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a469cf90-b952-424a-940b-c195857fb6f2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.996874] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1059.996960] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1059.997027] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1059.997203] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1059.997319] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.997426] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a469cf90-b952-424a-940b-c195857fb6f2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1059.997568] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a469cf90-b952-424a-940b-c195857fb6f2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.004222] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.004283] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.004380] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.004447] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.004639] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.004716] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.004804] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5988a824-4ff2-477d-8139-5418f9c569e4 is going to be updated. [ 1060.005958] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.006829] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.007052] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.007725] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b94d044-5ce0-4270-aced-c26d396494bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.007897] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.008079] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.089632] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.089967] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.090208] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.090293] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.090518] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.090606] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.090833] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.090978] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.091040] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.091173] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.091261] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.091488] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.091595] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.091672] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.091840] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.091916] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.092024] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d226a97-2d69-4706-b98b-565700008c6f is going to be updated. [ 1060.093126] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.093280] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.103110] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.103273] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.104674] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1060.171026] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.171026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.171861] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.172170] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.172311] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.172358] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.172564] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.172643] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.172852] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.172977] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.173054] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.173206] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.173280] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.173462] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.173544] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.173593] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.173724] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.173794] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.173882] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb is going to be updated. [ 1060.174997] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.175213] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.175327] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.176503] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.176503] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.176747] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.178665] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.180042] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.180042] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.180042] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.180254] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.180362] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.239563] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6768b7ab-f09a-42ec-87a9-9546009ee043 in Status: IN_PROGRESS for 2s [ 1060.240259] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 in Status: IN_PROGRESS for 2s [ 1060.240884] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 in Status: IN_PROGRESS for 2s [ 1060.243110] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 in Status: IN_PROGRESS for 2s [ 1060.261221] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.261422] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.261422] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.261645] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.261793] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.279017] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5988a824-4ff2-477d-8139-5418f9c569e4 in Status: IN_PROGRESS for 2s [ 1060.333793] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.333793] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.333793] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.333793] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.333793] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.393019] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.394801] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.394801] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.394801] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.394801] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.407199] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: IN_PROGRESS for 2s [ 1060.446440] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb in Status: IN_PROGRESS for 2s [ 1060.501288] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a469cf90-b952-424a-940b-c195857fb6f2: rpc.has_security_group_logging(os_id): False [ 1060.527898] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.527898] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.527898] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.528277] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.528277] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.528351] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.528397] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.528464] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.528617] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.528695] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.528901] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.529140] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.529140] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.529210] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.529266] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.529458] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.529551] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.529613] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.529752] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.529825] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.529912] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a469cf90-b952-424a-940b-c195857fb6f2 is going to be created. [ 1060.610904] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.610904] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.610904] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.610904] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.610904] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.610904] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea is going to be updated. [ 1060.615515] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.615756] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.615844] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.616030] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.616908] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.636259] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a469cf90-b952-424a-940b-c195857fb6f2 in Status: IN_PROGRESS for 2s [ 1060.687175] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.687346] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.687465] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.687626] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.687774] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.698622] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: IN_PROGRESS for 2s [ 1061.480051] env[66502]: INFO networking_nsxv3.common.synchronization [None req-f0c65489-6713-4d7e-8c7b-fc965f837021 None None] Enqueued Resource ID: 7fb7d5d9-01bb-4856-9c3f-f7823ad9408c with Priority: HIGHEST for action port [ 1061.483187] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7fb7d5d9-01bb-4856-9c3f-f7823ad9408c with Priority: HIGHEST for action port [ 1061.483187] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-7fb7d5d9-01bb-4856-9c3f-f7823ad9408c taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.483187] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7fb7d5d9-01bb-4856-9c3f-f7823ad9408c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.483187] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7fb7d5d9-01bb-4856-9c3f-f7823ad9408c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.483187] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7fb7d5d9-01bb-4856-9c3f-f7823ad9408c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.483187] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7fb7d5d9-01bb-4856-9c3f-f7823ad9408c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1061.985387] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7fb7d5d9-01bb-4856-9c3f-f7823ad9408c [ 1061.985387] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1061.985518] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1061.985518] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1061.985739] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1061.986125] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1061.986125] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7fb7d5d9-01bb-4856-9c3f-f7823ad9408c already deleted. [ 1061.986125] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7fb7d5d9-01bb-4856-9c3f-f7823ad9408c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.259749] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 in Status: SUCCESS [ 1062.259988] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.261972] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 in Status: SUCCESS [ 1062.262257] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.263190] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6768b7ab-f09a-42ec-87a9-9546009ee043 in Status: SUCCESS [ 1062.263406] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6768b7ab-f09a-42ec-87a9-9546009ee043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.264172] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 in Status: SUCCESS [ 1062.264412] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.293136] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5988a824-4ff2-477d-8139-5418f9c569e4 in Status: SUCCESS [ 1062.293370] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5988a824-4ff2-477d-8139-5418f9c569e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.425789] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: SUCCESS [ 1062.426025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.462428] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb in Status: SUCCESS [ 1062.462724] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.649148] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a469cf90-b952-424a-940b-c195857fb6f2 in Status: SUCCESS [ 1062.649489] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a469cf90-b952-424a-940b-c195857fb6f2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.710098] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: SUCCESS [ 1062.710098] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.710098] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.710375] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.710375] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.710502] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.710605] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.710736] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.710840] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.710955] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.711117] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.213998] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-704e5eab-aa44-4493-8c9a-0b24250e7bea taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.214679] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.214679] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.214679] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.214679] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.214904] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.214904] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.215043] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.215083] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.215170] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.215322] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-704e5eab-aa44-4493-8c9a-0b24250e7bea taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.215409] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.215455] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.215632] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.215795] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.215929] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.216016] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.216169] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.216257] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.216348] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.216438] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1063.718847] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 704e5eab-aa44-4493-8c9a-0b24250e7bea: rpc.has_security_group_logging(os_id): False [ 1063.738474] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.738636] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.738843] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.738925] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.770465] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.770736] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.770870] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.770938] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.771161] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.771246] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.771464] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.771557] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.771625] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.771794] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.772361] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.772361] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.772361] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.772361] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.772565] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.772565] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.772650] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea is going to be updated. [ 1063.845146] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.845466] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.845533] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.845781] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.845960] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.880112] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: IN_PROGRESS for 2s [ 1065.898832] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: SUCCESS [ 1065.899460] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.436406] env[66502]: INFO networking_nsxv3.common.synchronization [req-70c6e8fc-1e10-45ff-a417-3130a5dd173f req-76841c40-8ace-45f2-968c-fd8de93ee155 tempest-AttachVolumeNegativeTest-686526601 tempest-AttachVolumeNegativeTest-686526601-project-member] Enqueued Resource ID: 5988a824-4ff2-477d-8139-5418f9c569e4 with Priority: HIGHEST for action security_group_members [ 1066.436971] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5988a824-4ff2-477d-8139-5418f9c569e4 with Priority: HIGHEST for action security_group_members [ 1066.437309] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-5988a824-4ff2-477d-8139-5418f9c569e4 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.437434] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5988a824-4ff2-477d-8139-5418f9c569e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.437503] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5988a824-4ff2-477d-8139-5418f9c569e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.437710] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5988a824-4ff2-477d-8139-5418f9c569e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.437863] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.437991] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.438230] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.438404] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.438492] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.438592] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5988a824-4ff2-477d-8139-5418f9c569e4',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1066.943941] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.944339] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.944339] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.944339] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.944614] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.944614] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.944744] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.944842] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.944886] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.945156] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.945156] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5988a824-4ff2-477d-8139-5418f9c569e4 is going to be updated. [ 1066.979341] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.979518] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.979566] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.979743] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.979878] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.989512] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5988a824-4ff2-477d-8139-5418f9c569e4 in Status: IN_PROGRESS for 2s [ 1067.970185] env[66502]: INFO networking_nsxv3.common.synchronization [req-89b9addf-5e19-43c4-9846-90b5a7e70750 req-f14b695c-e08e-478a-b6f8-81e275092aea tempest-InstanceActionsTestJSON-915703581 tempest-InstanceActionsTestJSON-915703581-project-member] Enqueued Resource ID: f88da942-4241-46c3-a802-06b5afc96ff7 with Priority: HIGHEST for action security_group_members [ 1067.970185] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f88da942-4241-46c3-a802-06b5afc96ff7 with Priority: HIGHEST for action security_group_members [ 1067.970185] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-f88da942-4241-46c3-a802-06b5afc96ff7 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.970185] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f88da942-4241-46c3-a802-06b5afc96ff7" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.970185] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f88da942-4241-46c3-a802-06b5afc96ff7" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.970185] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f88da942-4241-46c3-a802-06b5afc96ff7" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.971031] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.971313] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.971489] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.971771] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.971975] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.972244] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f88da942-4241-46c3-a802-06b5afc96ff7',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.354294] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-58 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.354575] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-58" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.354723] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-58" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.355581] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-58" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.355913] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.356139] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.356271] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.356526] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.356743] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.356991] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1068.357125] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1068.357238] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1068.357345] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1068.357459] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1068.357559] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1068.357703] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1068.379841] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1068.380177] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1068.380410] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1068.380797] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-58" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.381368] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-6ad16fd9-cdaf-440b-bb5a-75d36c64e823 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.381633] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-6ad16fd9-cdaf-440b-bb5a-75d36c64e823" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.381855] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-6ad16fd9-cdaf-440b-bb5a-75d36c64e823" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.385327] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-6ad16fd9-cdaf-440b-bb5a-75d36c64e823" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.385327] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ad16fd9-cdaf-440b-bb5a-75d36c64e823',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.476597] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.476803] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.476861] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.477074] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.477176] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.477396] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.477500] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.477562] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.477720] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.478128] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.478128] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f88da942-4241-46c3-a802-06b5afc96ff7 already deleted. [ 1068.478128] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f88da942-4241-46c3-a802-06b5afc96ff7" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.670629] env[66502]: INFO networking_nsxv3.common.synchronization [req-ee212da1-2f50-4cdf-8dad-3617f0c698a6 req-38860077-c8ce-4347-8bb7-4a2b5832247a tempest-ServerActionsTestJSON-2133613622 tempest-ServerActionsTestJSON-2133613622-project-member] Enqueued Resource ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 with Priority: HIGHEST for action security_group_members [ 1068.671257] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 with Priority: HIGHEST for action security_group_members [ 1068.671769] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.671927] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.672015] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.672248] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.672412] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.672510] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.672570] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.672711] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.672822] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.672923] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ab1d50c-f5a6-4aaf-829b-d0cfdf164722',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.887035] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.887199] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.887199] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.887503] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.887681] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.890111] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 6ad16fd9-cdaf-440b-bb5a-75d36c64e823 not found, creating... [ 1068.890726] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.890726] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.890950] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.891068] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.891246] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.891569] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.893979] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.893979] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.893979] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.893979] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.893979] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 6ad16fd9-cdaf-440b-bb5a-75d36c64e823 is going to be created. [ 1068.917692] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.917920] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.918070] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.918394] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.918625] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.918863] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-6ad16fd9-cdaf-440b-bb5a-75d36c64e823" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.003111] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5988a824-4ff2-477d-8139-5418f9c569e4 in Status: SUCCESS [ 1069.003456] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5988a824-4ff2-477d-8139-5418f9c569e4 deletion is rescheduled due to dependency. [ 1069.003543] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5988a824-4ff2-477d-8139-5418f9c569e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.176077] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.176405] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.176618] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.176938] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.177172] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.177538] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.177826] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.177944] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.178304] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.178500] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.178691] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 is going to be updated. [ 1069.220770] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.220958] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.220998] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.221301] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.221590] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.232072] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 in Status: IN_PROGRESS for 2s [ 1069.518338] env[66502]: INFO networking_nsxv3.common.synchronization [req-b06c59db-e0fc-4bbb-a22f-1ef431493d2e req-d08fd508-2c9d-4b27-831f-b642592420e1 tempest-ServerActionsTestOtherB-501490242 tempest-ServerActionsTestOtherB-501490242-project-member] Enqueued Resource ID: 670eb61a-b688-45b2-9400-64232c7b8af0 with Priority: HIGHEST for action security_group_members [ 1069.519221] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 670eb61a-b688-45b2-9400-64232c7b8af0 with Priority: HIGHEST for action security_group_members [ 1069.519664] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-670eb61a-b688-45b2-9400-64232c7b8af0 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.519794] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.519863] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.520096] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.520264] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.520358] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.520421] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.520578] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.520665] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.520765] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('670eb61a-b688-45b2-9400-64232c7b8af0',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.620844] env[66502]: INFO networking_nsxv3.common.synchronization [req-89b9addf-5e19-43c4-9846-90b5a7e70750 req-dbd72dd0-961e-45db-b7de-b88741dbc820 service nova] Enqueued Resource ID: f88da942-4241-46c3-a802-06b5afc96ff7 with Priority: HIGHEST for action security_group_rules [ 1069.621121] env[66502]: INFO networking_nsxv3.common.synchronization [req-89b9addf-5e19-43c4-9846-90b5a7e70750 req-dbd72dd0-961e-45db-b7de-b88741dbc820 service nova] Enqueued Resource ID: f88da942-4241-46c3-a802-06b5afc96ff7 with Priority: HIGHEST for action security_group_members [ 1069.621338] env[66502]: INFO networking_nsxv3.common.synchronization [req-89b9addf-5e19-43c4-9846-90b5a7e70750 req-dbd72dd0-961e-45db-b7de-b88741dbc820 service nova] Enqueued Resource ID: 6ad16fd9-cdaf-440b-bb5a-75d36c64e823 with Priority: HIGHEST for action port [ 1069.622900] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f88da942-4241-46c3-a802-06b5afc96ff7 with Priority: HIGHEST for action security_group_rules [ 1069.623103] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f88da942-4241-46c3-a802-06b5afc96ff7 with Priority: HIGHEST for action security_group_members [ 1069.623248] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ad16fd9-cdaf-440b-bb5a-75d36c64e823 with Priority: HIGHEST for action port [ 1069.623844] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f88da942-4241-46c3-a802-06b5afc96ff7 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.624744] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f88da942-4241-46c3-a802-06b5afc96ff7" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.624744] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f88da942-4241-46c3-a802-06b5afc96ff7" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.624744] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f88da942-4241-46c3-a802-06b5afc96ff7" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.624744] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f88da942-4241-46c3-a802-06b5afc96ff7',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.626895] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-f88da942-4241-46c3-a802-06b5afc96ff7 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.627091] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f88da942-4241-46c3-a802-06b5afc96ff7" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.627173] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f88da942-4241-46c3-a802-06b5afc96ff7" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.627441] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f88da942-4241-46c3-a802-06b5afc96ff7" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.627655] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.627790] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.627887] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.628254] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.628516] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1069.628563] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f88da942-4241-46c3-a802-06b5afc96ff7',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1069.630393] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ad16fd9-cdaf-440b-bb5a-75d36c64e823 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1069.631068] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ad16fd9-cdaf-440b-bb5a-75d36c64e823" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1069.633967] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ad16fd9-cdaf-440b-bb5a-75d36c64e823" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1069.633967] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ad16fd9-cdaf-440b-bb5a-75d36c64e823" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1069.633967] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ad16fd9-cdaf-440b-bb5a-75d36c64e823',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.023686] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.023969] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.023969] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.024336] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.046499] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.046885] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.047087] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.047141] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.047358] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.047452] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.047552] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 670eb61a-b688-45b2-9400-64232c7b8af0 is going to be updated. [ 1070.101309] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.101462] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.101517] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.101739] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.101884] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.111951] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 670eb61a-b688-45b2-9400-64232c7b8af0 in Status: IN_PROGRESS for 2s [ 1070.127584] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-f88da942-4241-46c3-a802-06b5afc96ff7 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.127763] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f88da942-4241-46c3-a802-06b5afc96ff7" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.131170] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f88da942-4241-46c3-a802-06b5afc96ff7',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.135685] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6ad16fd9-cdaf-440b-bb5a-75d36c64e823 with status ACTIVE [ 1070.135938] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.136103] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.136217] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.136462] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.136599] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.136836] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.137052] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.137052] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.137226] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.137320] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.137509] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.137649] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.137737] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.137941] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.138064] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.138211] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6ad16fd9-cdaf-440b-bb5a-75d36c64e823 is going to be updated. [ 1070.163188] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.163387] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.164415] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.164415] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.164415] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.164415] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ad16fd9-cdaf-440b-bb5a-75d36c64e823" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.632902] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f88da942-4241-46c3-a802-06b5afc96ff7',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.135988] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.135988] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.135988] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.136442] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.136442] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.136442] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f88da942-4241-46c3-a802-06b5afc96ff7 is going to be created. [ 1071.163783] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.163951] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.164035] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.164260] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.164421] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.173261] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f88da942-4241-46c3-a802-06b5afc96ff7 in Status: UNINITIALIZED for 2s [ 1071.241979] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 in Status: IN_PROGRESS for 4s [ 1072.123607] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 670eb61a-b688-45b2-9400-64232c7b8af0 in Status: SUCCESS [ 1072.123849] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 670eb61a-b688-45b2-9400-64232c7b8af0 deletion is rescheduled due to dependency. [ 1072.124018] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.186763] env[66502]: INFO networking_nsxv3.common.synchronization [req-31bc3a48-de90-4b64-92f5-c00fc588094f req-337bb1ee-a409-4a02-ace2-2896272c740d tempest-ServersTestJSON-1210226259 tempest-ServersTestJSON-1210226259-project-member] Enqueued Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_members [ 1072.187629] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_members [ 1072.187991] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.188953] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.188953] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.189766] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.190047] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.190178] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.190386] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.190639] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.190718] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.190823] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.694687] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.722265] env[66502]: INFO networking_nsxv3.common.synchronization [req-6c14a33c-b6b0-4660-b25f-af1a1b0ea1e3 req-60b05332-dc4f-4200-8b9d-4469bc4fa86d tempest-DeleteServersTestJSON-51385704 tempest-DeleteServersTestJSON-51385704-project-member] Enqueued Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_members [ 1072.722718] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_members [ 1072.723068] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-704e5eab-aa44-4493-8c9a-0b24250e7bea taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.723238] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.723318] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.723550] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.723729] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.723856] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.723938] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.724207] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.724316] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.724678] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.185906] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f88da942-4241-46c3-a802-06b5afc96ff7 in Status: SUCCESS [ 1073.186098] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f88da942-4241-46c3-a802-06b5afc96ff7" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.186590] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f88da942-4241-46c3-a802-06b5afc96ff7" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.186823] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f88da942-4241-46c3-a802-06b5afc96ff7" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.187072] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.187146] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.187207] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.187351] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.187426] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.187504] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f88da942-4241-46c3-a802-06b5afc96ff7" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.187586] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f88da942-4241-46c3-a802-06b5afc96ff7',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.201464] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.226601] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.226784] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.226784] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.227068] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.227144] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.227379] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.227494] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.227556] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.227711] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.227785] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.227867] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea is going to be updated. [ 1073.254556] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 in Status: SUCCESS [ 1073.255305] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 deletion is rescheduled due to dependency. [ 1073.255305] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.267342] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.267569] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.267640] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.267925] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.267991] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.278820] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: IN_PROGRESS for 2s [ 1073.692257] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-f88da942-4241-46c3-a802-06b5afc96ff7 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.692434] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f88da942-4241-46c3-a802-06b5afc96ff7" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.692508] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f88da942-4241-46c3-a802-06b5afc96ff7" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.692790] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f88da942-4241-46c3-a802-06b5afc96ff7" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.692997] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.693124] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.693179] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.693385] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.693487] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.693568] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f88da942-4241-46c3-a802-06b5afc96ff7" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.693728] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-f88da942-4241-46c3-a802-06b5afc96ff7 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.693822] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f88da942-4241-46c3-a802-06b5afc96ff7" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.693879] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f88da942-4241-46c3-a802-06b5afc96ff7" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.694038] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f88da942-4241-46c3-a802-06b5afc96ff7" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.694199] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.694298] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.694388] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.694541] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.694615] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.694700] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f88da942-4241-46c3-a802-06b5afc96ff7" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.694799] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f88da942-4241-46c3-a802-06b5afc96ff7',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.704751] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.704896] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.705025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.705295] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.705404] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.705518] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d226a97-2d69-4706-b98b-565700008c6f is going to be updated. [ 1073.735417] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.735560] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.735614] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.735813] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.735952] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.745887] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: IN_PROGRESS for 2s [ 1074.198015] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f88da942-4241-46c3-a802-06b5afc96ff7: rpc.has_security_group_logging(os_id): False [ 1074.222246] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.222246] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.222246] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.222246] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.222246] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.222246] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.222620] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.222620] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.222620] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.222620] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.222821] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.222913] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.222974] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.223162] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.223213] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.223421] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.223520] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.223580] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.223718] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.223792] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.223876] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f88da942-4241-46c3-a802-06b5afc96ff7 is going to be created. [ 1074.286995] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.287206] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.287562] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.287562] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.287832] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.316327] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f88da942-4241-46c3-a802-06b5afc96ff7 in Status: IN_PROGRESS for 2s [ 1074.378881] env[66502]: INFO networking_nsxv3.common.synchronization [req-b8a3d515-ea9a-4616-a3d4-e4f6e8d5bd45 req-66584c9e-14a6-45b6-a4e2-b9c9f91f91d9 tempest-ServerRescueTestJSON-982442935 tempest-ServerRescueTestJSON-982442935-project-member] Enqueued Resource ID: 0880fb6e-a350-4602-9874-47125beb1eb3 with Priority: HIGHEST for action security_group_members [ 1074.379580] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0880fb6e-a350-4602-9874-47125beb1eb3 with Priority: HIGHEST for action security_group_members [ 1074.379912] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0880fb6e-a350-4602-9874-47125beb1eb3 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.380081] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.380209] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.380480] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.380880] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.380880] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.380880] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.381056] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.381056] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.381177] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0880fb6e-a350-4602-9874-47125beb1eb3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.794889] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-332 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.794889] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-332" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.794889] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-332" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.795213] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-332" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.795477] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.796070] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.796070] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.796813] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.798013] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.798013] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1074.798013] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1074.798013] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1074.798013] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1074.798013] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1074.798013] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1074.798013] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1074.820252] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1074.820252] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1074.820614] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1074.820750] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-332" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.821379] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-ef54dd5c-a3f5-4a1b-9576-7715b92937f6 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.821688] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-ef54dd5c-a3f5-4a1b-9576-7715b92937f6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.821795] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-ef54dd5c-a3f5-4a1b-9576-7715b92937f6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.822315] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-ef54dd5c-a3f5-4a1b-9576-7715b92937f6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.822315] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef54dd5c-a3f5-4a1b-9576-7715b92937f6',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.883551] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.883670] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.883741] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.883959] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.884062] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.884297] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.884361] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.884425] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.884573] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.884650] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.884733] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0880fb6e-a350-4602-9874-47125beb1eb3 already deleted. [ 1074.884811] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.290309] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: SUCCESS [ 1075.291227] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea deletion is rescheduled due to dependency. [ 1075.291475] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.325503] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.326170] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.326170] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.326357] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.326357] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.326483] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port ef54dd5c-a3f5-4a1b-9576-7715b92937f6 not found, creating... [ 1075.326753] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.326926] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.327031] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.327260] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.327394] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.327699] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.328833] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.328833] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.328833] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.328833] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.328833] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: ef54dd5c-a3f5-4a1b-9576-7715b92937f6 is going to be created. [ 1075.352887] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.353176] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.353336] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.353729] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.353996] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.354282] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-ef54dd5c-a3f5-4a1b-9576-7715b92937f6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.758739] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: SUCCESS [ 1075.758872] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.078395] env[66502]: INFO networking_nsxv3.common.synchronization [req-b8a3d515-ea9a-4616-a3d4-e4f6e8d5bd45 req-d16c22f6-3dcc-42ba-a8bf-c85c8d1a3082 service nova] Enqueued Resource ID: 0880fb6e-a350-4602-9874-47125beb1eb3 with Priority: HIGHEST for action security_group_rules [ 1076.078568] env[66502]: INFO networking_nsxv3.common.synchronization [req-b8a3d515-ea9a-4616-a3d4-e4f6e8d5bd45 req-d16c22f6-3dcc-42ba-a8bf-c85c8d1a3082 service nova] Enqueued Resource ID: 0880fb6e-a350-4602-9874-47125beb1eb3 with Priority: HIGHEST for action security_group_members [ 1076.078734] env[66502]: INFO networking_nsxv3.common.synchronization [req-b8a3d515-ea9a-4616-a3d4-e4f6e8d5bd45 req-d16c22f6-3dcc-42ba-a8bf-c85c8d1a3082 service nova] Enqueued Resource ID: ef54dd5c-a3f5-4a1b-9576-7715b92937f6 with Priority: HIGHEST for action port [ 1076.079327] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0880fb6e-a350-4602-9874-47125beb1eb3 with Priority: HIGHEST for action security_group_rules [ 1076.079456] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0880fb6e-a350-4602-9874-47125beb1eb3 with Priority: HIGHEST for action security_group_members [ 1076.079629] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef54dd5c-a3f5-4a1b-9576-7715b92937f6 with Priority: HIGHEST for action port [ 1076.079826] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0880fb6e-a350-4602-9874-47125beb1eb3 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.079944] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.080036] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.080301] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.080638] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0880fb6e-a350-4602-9874-47125beb1eb3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.081832] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0880fb6e-a350-4602-9874-47125beb1eb3 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.081954] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.082048] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.082243] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.082399] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.082530] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.082581] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.082729] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.082834] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.082927] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0880fb6e-a350-4602-9874-47125beb1eb3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.083709] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef54dd5c-a3f5-4a1b-9576-7715b92937f6 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.083817] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef54dd5c-a3f5-4a1b-9576-7715b92937f6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.083874] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef54dd5c-a3f5-4a1b-9576-7715b92937f6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.084882] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef54dd5c-a3f5-4a1b-9576-7715b92937f6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.084882] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef54dd5c-a3f5-4a1b-9576-7715b92937f6',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.327773] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f88da942-4241-46c3-a802-06b5afc96ff7 in Status: SUCCESS [ 1076.328129] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f88da942-4241-46c3-a802-06b5afc96ff7" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.589377] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0880fb6e-a350-4602-9874-47125beb1eb3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.589377] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0880fb6e-a350-4602-9874-47125beb1eb3 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.589377] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.589377] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ef54dd5c-a3f5-4a1b-9576-7715b92937f6 with status ACTIVE [ 1076.589377] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.589377] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.589377] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.589377] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.589377] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.589377] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.589377] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.589377] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.589377] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.589377] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.590918] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.592221] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.592692] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.592837] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.594033] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.594033] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ef54dd5c-a3f5-4a1b-9576-7715b92937f6 is going to be updated. [ 1076.630277] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.630429] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.630500] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.630719] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.630871] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.631034] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef54dd5c-a3f5-4a1b-9576-7715b92937f6" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.088192] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0880fb6e-a350-4602-9874-47125beb1eb3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.502356] env[66502]: INFO networking_nsxv3.common.synchronization [req-4c6dec2f-d0ce-43d2-a191-01c02bae1078 req-0aa71aea-65da-47ac-abbf-56444e48c4de tempest-AttachInterfacesTestJSON-1531294335 tempest-AttachInterfacesTestJSON-1531294335-project-member] Enqueued Resource ID: 3f796883-7322-4113-bfa9-5a64b4903a46 with Priority: HIGHEST for action security_group_members [ 1077.503150] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f796883-7322-4113-bfa9-5a64b4903a46 with Priority: HIGHEST for action security_group_members [ 1077.503834] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f796883-7322-4113-bfa9-5a64b4903a46 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.503834] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.503934] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.504252] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.504471] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.504728] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.506398] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.506398] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.506398] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.506398] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f796883-7322-4113-bfa9-5a64b4903a46',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.591526] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.591704] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.591745] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.591980] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.592085] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.592185] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0880fb6e-a350-4602-9874-47125beb1eb3 is going to be created. [ 1077.616773] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.616935] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.617016] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.617242] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.617880] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.629444] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0880fb6e-a350-4602-9874-47125beb1eb3 in Status: UNINITIALIZED for 2s [ 1077.802191] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-584 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.802191] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-584" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.802191] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-584" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.802191] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-584" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.802409] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.802640] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.802788] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.802977] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.803130] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.803400] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1077.803451] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1077.803561] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1077.803666] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1077.803771] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1077.803889] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1077.804040] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1077.823035] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1077.823208] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1077.823349] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1077.823540] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-584" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.823863] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-82048fd7-6cad-4bfd-904d-1c6bb0298878 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.824043] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-82048fd7-6cad-4bfd-904d-1c6bb0298878" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.824188] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-82048fd7-6cad-4bfd-904d-1c6bb0298878" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.824512] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-82048fd7-6cad-4bfd-904d-1c6bb0298878" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.824652] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82048fd7-6cad-4bfd-904d-1c6bb0298878',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.008755] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.008944] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.008988] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.009329] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.009402] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.009590] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.009698] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.009751] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.009898] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.009970] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.010071] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f796883-7322-4113-bfa9-5a64b4903a46 already deleted. [ 1078.010157] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.327591] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.327897] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.327997] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.328300] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.328483] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.328645] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port 82048fd7-6cad-4bfd-904d-1c6bb0298878 not found, creating... [ 1078.328933] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.329408] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.329408] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.329573] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.329726] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.330051] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.330223] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.330423] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.330566] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.330715] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.330899] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: 82048fd7-6cad-4bfd-904d-1c6bb0298878 is going to be created. [ 1078.361961] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.362164] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.362283] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.362836] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.363095] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.363642] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-82048fd7-6cad-4bfd-904d-1c6bb0298878" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.130258] env[66502]: INFO networking_nsxv3.common.synchronization [req-4c6dec2f-d0ce-43d2-a191-01c02bae1078 req-f4d447a7-cfc5-4c5e-afa6-884d3b757546 service nova] Enqueued Resource ID: 3f796883-7322-4113-bfa9-5a64b4903a46 with Priority: HIGHEST for action security_group_rules [ 1079.130258] env[66502]: INFO networking_nsxv3.common.synchronization [req-4c6dec2f-d0ce-43d2-a191-01c02bae1078 req-f4d447a7-cfc5-4c5e-afa6-884d3b757546 service nova] Enqueued Resource ID: 3f796883-7322-4113-bfa9-5a64b4903a46 with Priority: HIGHEST for action security_group_members [ 1079.130258] env[66502]: INFO networking_nsxv3.common.synchronization [req-4c6dec2f-d0ce-43d2-a191-01c02bae1078 req-f4d447a7-cfc5-4c5e-afa6-884d3b757546 service nova] Enqueued Resource ID: 82048fd7-6cad-4bfd-904d-1c6bb0298878 with Priority: HIGHEST for action port [ 1079.130855] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f796883-7322-4113-bfa9-5a64b4903a46 with Priority: HIGHEST for action security_group_rules [ 1079.131192] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f796883-7322-4113-bfa9-5a64b4903a46 with Priority: HIGHEST for action security_group_members [ 1079.131430] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82048fd7-6cad-4bfd-904d-1c6bb0298878 with Priority: HIGHEST for action port [ 1079.131823] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f796883-7322-4113-bfa9-5a64b4903a46 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.132087] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.132230] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.132614] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.132799] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f796883-7322-4113-bfa9-5a64b4903a46',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.134336] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f796883-7322-4113-bfa9-5a64b4903a46 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.134580] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.134733] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.134992] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.135261] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.135514] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.135682] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.135919] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.136378] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.136571] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f796883-7322-4113-bfa9-5a64b4903a46',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.137573] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-82048fd7-6cad-4bfd-904d-1c6bb0298878 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.138020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82048fd7-6cad-4bfd-904d-1c6bb0298878" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.138020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82048fd7-6cad-4bfd-904d-1c6bb0298878" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.138998] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82048fd7-6cad-4bfd-904d-1c6bb0298878" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.138998] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82048fd7-6cad-4bfd-904d-1c6bb0298878',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.641790] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0880fb6e-a350-4602-9874-47125beb1eb3 in Status: SUCCESS [ 1079.642047] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.642312] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3f796883-7322-4113-bfa9-5a64b4903a46',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.644825] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f796883-7322-4113-bfa9-5a64b4903a46 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.644942] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.645121] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 82048fd7-6cad-4bfd-904d-1c6bb0298878 with status ACTIVE [ 1079.645294] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.645404] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.645468] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.645666] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.645764] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.646167] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.646340] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.646900] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.647594] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.647731] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.647970] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.648135] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.648311] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.648464] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.648557] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.648643] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 82048fd7-6cad-4bfd-904d-1c6bb0298878 is going to be updated. [ 1079.649673] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.649842] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.650098] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.650245] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.650339] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.650532] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.651069] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.651198] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.651322] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0880fb6e-a350-4602-9874-47125beb1eb3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.672921] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.673086] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.673157] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.673364] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.673502] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.673669] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82048fd7-6cad-4bfd-904d-1c6bb0298878" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.677873] env[66502]: INFO networking_nsxv3.common.synchronization [None req-45e24b3e-b902-4cd2-9d02-e9d0464b2cdf tempest-AttachVolumeNegativeTest-686526601 tempest-AttachVolumeNegativeTest-686526601-project-member] Enqueued Resource ID: d9e364d3-a93f-4a56-a513-11d45b81aadf with Priority: HIGHEST for action security_group_rules [ 1079.678838] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9e364d3-a93f-4a56-a513-11d45b81aadf with Priority: HIGHEST for action security_group_rules [ 1079.679154] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9e364d3-a93f-4a56-a513-11d45b81aadf taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.679281] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9e364d3-a93f-4a56-a513-11d45b81aadf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.679386] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9e364d3-a93f-4a56-a513-11d45b81aadf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.679585] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9e364d3-a93f-4a56-a513-11d45b81aadf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.679666] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9e364d3-a93f-4a56-a513-11d45b81aadf',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.780752] env[66502]: INFO networking_nsxv3.common.synchronization [None req-5f4c9712-1e49-4bd3-ab01-14b1456b468f tempest-AttachVolumeNegativeTest-686526601 tempest-AttachVolumeNegativeTest-686526601-project-member] Enqueued Resource ID: d9e364d3-a93f-4a56-a513-11d45b81aadf with Priority: HIGHEST for action security_group_rules [ 1079.781366] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9e364d3-a93f-4a56-a513-11d45b81aadf with Priority: HIGHEST for action security_group_rules [ 1079.781668] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9e364d3-a93f-4a56-a513-11d45b81aadf taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.781776] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9e364d3-a93f-4a56-a513-11d45b81aadf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.154189] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0880fb6e-a350-4602-9874-47125beb1eb3 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.154623] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.154623] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.154623] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.154784] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.154863] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.154928] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.155108] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.155218] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.155313] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.155480] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0880fb6e-a350-4602-9874-47125beb1eb3 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.155591] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.155670] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.155808] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.155972] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.156115] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.156204] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.156355] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.156435] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.156569] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.156698] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0880fb6e-a350-4602-9874-47125beb1eb3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.157797] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3f796883-7322-4113-bfa9-5a64b4903a46',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.203282] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.203429] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.203496] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.203707] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.203794] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.203883] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9e364d3-a93f-4a56-a513-11d45b81aadf already deleted. [ 1080.203963] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9e364d3-a93f-4a56-a513-11d45b81aadf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.204118] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9e364d3-a93f-4a56-a513-11d45b81aadf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.204269] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9e364d3-a93f-4a56-a513-11d45b81aadf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.204348] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9e364d3-a93f-4a56-a513-11d45b81aadf',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.660107] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0880fb6e-a350-4602-9874-47125beb1eb3: rpc.has_security_group_logging(os_id): False [ 1080.661629] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.661918] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.662071] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.662229] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.662303] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.662405] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f796883-7322-4113-bfa9-5a64b4903a46 is going to be created. [ 1080.681749] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.681892] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.681950] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.682191] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.682409] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.682502] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.682600] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.682661] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.682824] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.682901] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.683103] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.683195] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.683255] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.683472] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.683472] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.683636] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.683725] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.683790] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.683924] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.683995] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.684426] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0880fb6e-a350-4602-9874-47125beb1eb3 is going to be created. [ 1080.688472] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.688598] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.688638] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.688810] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.688956] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.699197] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f796883-7322-4113-bfa9-5a64b4903a46 in Status: UNINITIALIZED for 2s [ 1080.726275] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.726434] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.726530] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.726780] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.726901] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.727052] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9e364d3-a93f-4a56-a513-11d45b81aadf already deleted. [ 1080.727163] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9e364d3-a93f-4a56-a513-11d45b81aadf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.748392] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.748572] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.748616] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.748831] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.749019] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.763341] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0880fb6e-a350-4602-9874-47125beb1eb3 in Status: IN_PROGRESS for 2s [ 1082.710627] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f796883-7322-4113-bfa9-5a64b4903a46 in Status: SUCCESS [ 1082.710971] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.711084] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.711440] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.711708] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.711947] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.711947] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.712150] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.712245] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.712358] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.712462] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3f796883-7322-4113-bfa9-5a64b4903a46',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.779113] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0880fb6e-a350-4602-9874-47125beb1eb3 in Status: SUCCESS [ 1082.779314] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.215186] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f796883-7322-4113-bfa9-5a64b4903a46 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.215524] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.215613] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.215849] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.216083] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.216184] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.216430] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.216430] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.216647] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.216647] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.216745] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f796883-7322-4113-bfa9-5a64b4903a46 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.216822] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.216878] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.217064] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.217227] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.217420] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.217420] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.217803] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.217803] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.217803] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.217803] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3f796883-7322-4113-bfa9-5a64b4903a46',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.719911] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3f796883-7322-4113-bfa9-5a64b4903a46: rpc.has_security_group_logging(os_id): False [ 1083.741570] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.741742] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.741781] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.742033] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.742125] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.742449] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.742551] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.742627] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.742822] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.742901] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.743105] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.743525] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.743525] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.743525] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.743525] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.743707] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.743770] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.743770] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.743971] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.744074] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.744164] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f796883-7322-4113-bfa9-5a64b4903a46 is going to be created. [ 1083.804300] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.804517] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.804610] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.805290] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.805493] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.823517] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f796883-7322-4113-bfa9-5a64b4903a46 in Status: IN_PROGRESS for 2s [ 1084.783120] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1084.783120] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1085.838713] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f796883-7322-4113-bfa9-5a64b4903a46 in Status: SUCCESS [ 1085.839088] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.159569] env[66502]: INFO networking_nsxv3.common.synchronization [req-24019437-8eed-4b7b-8056-12be7d850ddb req-1d6515e0-f900-44a9-a832-a937127ebd9f tempest-ServerDiskConfigTestJSON-940033598 tempest-ServerDiskConfigTestJSON-940033598-project-member] Enqueued Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGHEST for action security_group_members [ 1086.159569] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGHEST for action security_group_members [ 1086.159569] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-aba51398-48dc-4f5e-b3cf-1da4130d58fb taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.159569] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.159569] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.159569] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.159569] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.159569] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.159569] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.160466] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.160466] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.160466] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.663325] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.663579] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.663706] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.664424] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.664424] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.664567] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.664626] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.664723] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.664970] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.665086] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.665487] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb is going to be updated. [ 1086.693302] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.693302] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.693302] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.693578] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.693787] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.704395] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb in Status: IN_PROGRESS for 2s [ 1087.593520] env[66502]: INFO networking_nsxv3.common.synchronization [req-57eb4293-db43-4426-bde9-d9e4863bb1ec req-98eb3023-664d-4129-9e1f-373bbfb463a3 tempest-InstanceActionsTestJSON-915703581 tempest-InstanceActionsTestJSON-915703581-project-member] Enqueued Resource ID: f88da942-4241-46c3-a802-06b5afc96ff7 with Priority: HIGHEST for action security_group_members [ 1087.593520] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f88da942-4241-46c3-a802-06b5afc96ff7 with Priority: HIGHEST for action security_group_members [ 1087.593866] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-f88da942-4241-46c3-a802-06b5afc96ff7 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.593866] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f88da942-4241-46c3-a802-06b5afc96ff7" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.593949] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f88da942-4241-46c3-a802-06b5afc96ff7" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.594353] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f88da942-4241-46c3-a802-06b5afc96ff7" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.594458] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.594805] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.594805] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.595418] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.595579] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.595741] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f88da942-4241-46c3-a802-06b5afc96ff7',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.102274] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.102274] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.102274] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.102274] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.102274] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.102274] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.102274] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.102799] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.102799] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.102799] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.102799] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f88da942-4241-46c3-a802-06b5afc96ff7 is going to be updated. [ 1088.129429] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.129578] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.129729] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.129936] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.130118] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.140367] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f88da942-4241-46c3-a802-06b5afc96ff7 in Status: IN_PROGRESS for 2s [ 1088.715647] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb in Status: SUCCESS [ 1088.715943] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb deletion is rescheduled due to dependency. [ 1088.715943] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.159634] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f88da942-4241-46c3-a802-06b5afc96ff7 in Status: SUCCESS [ 1090.160087] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f88da942-4241-46c3-a802-06b5afc96ff7 deletion is rescheduled due to dependency. [ 1090.160087] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f88da942-4241-46c3-a802-06b5afc96ff7" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.441406] env[66502]: INFO networking_nsxv3.common.synchronization [req-ffaa90df-cbbd-4bc3-9d4c-029c1d47d48b req-bd8c9ca1-ff2b-41cf-9f3a-7399e36128f9 tempest-AttachVolumeNegativeTest-686526601 tempest-AttachVolumeNegativeTest-686526601-project-member] Enqueued Resource ID: d9e364d3-a93f-4a56-a513-11d45b81aadf with Priority: HIGHEST for action security_group_members [ 1091.444794] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9e364d3-a93f-4a56-a513-11d45b81aadf with Priority: HIGHEST for action security_group_members [ 1091.444794] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9e364d3-a93f-4a56-a513-11d45b81aadf taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.444794] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9e364d3-a93f-4a56-a513-11d45b81aadf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.444794] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9e364d3-a93f-4a56-a513-11d45b81aadf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.444794] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9e364d3-a93f-4a56-a513-11d45b81aadf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.444794] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.444794] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.444794] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.444794] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.444794] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.444794] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9e364d3-a93f-4a56-a513-11d45b81aadf',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.838661] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-647 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.838954] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-647" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.839167] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-647" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.839536] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-647" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.839864] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.840049] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.840170] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.840424] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.840585] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.840844] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1091.840904] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1091.840997] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1091.841192] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1091.841421] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1091.841563] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1091.841709] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1091.863876] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1091.864087] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1091.864316] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1091.864556] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-647" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.864972] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-38735252-9b69-4a83-870c-b86ad0f78429 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.865197] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-38735252-9b69-4a83-870c-b86ad0f78429" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.865408] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-38735252-9b69-4a83-870c-b86ad0f78429" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.865815] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-38735252-9b69-4a83-870c-b86ad0f78429" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.865972] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38735252-9b69-4a83-870c-b86ad0f78429',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.948324] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.948496] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.948639] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.948885] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.949073] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.949322] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.949456] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.949684] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.949823] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.949929] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.950045] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9e364d3-a93f-4a56-a513-11d45b81aadf already deleted. [ 1091.950133] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9e364d3-a93f-4a56-a513-11d45b81aadf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.367940] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.368222] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.368355] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.368718] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.368912] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.369318] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 38735252-9b69-4a83-870c-b86ad0f78429 not found, creating... [ 1092.369490] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.369718] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.369886] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.370186] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.370355] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.370675] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.370861] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.371009] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.371275] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.371432] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.371547] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 38735252-9b69-4a83-870c-b86ad0f78429 is going to be created. [ 1092.396487] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.396710] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.396839] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.397141] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.397372] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.397598] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-38735252-9b69-4a83-870c-b86ad0f78429" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.624084] env[66502]: INFO networking_nsxv3.common.synchronization [req-4e96dc43-59c1-4abe-ab35-b962e2132d6c req-db1ef64e-49e3-4754-b10c-4d672edb9e76 tempest-AttachInterfacesTestJSON-1531294335 tempest-AttachInterfacesTestJSON-1531294335-project-member] Enqueued Resource ID: 3f796883-7322-4113-bfa9-5a64b4903a46 with Priority: HIGHEST for action security_group_members [ 1092.624619] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f796883-7322-4113-bfa9-5a64b4903a46 with Priority: HIGHEST for action security_group_members [ 1092.624936] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f796883-7322-4113-bfa9-5a64b4903a46 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.625212] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.625304] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.625550] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.625739] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.625889] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.625918] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.626088] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.626902] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.627039] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f796883-7322-4113-bfa9-5a64b4903a46',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.130434] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.130623] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.130694] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.131230] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.131230] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.131474] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.131474] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.131587] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.131726] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.131843] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.131962] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f796883-7322-4113-bfa9-5a64b4903a46 is going to be updated. [ 1093.166847] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.167216] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.167216] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.167568] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.167697] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.180727] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f796883-7322-4113-bfa9-5a64b4903a46 in Status: IN_PROGRESS for 2s [ 1093.590063] env[66502]: INFO networking_nsxv3.common.synchronization [req-ffaa90df-cbbd-4bc3-9d4c-029c1d47d48b req-ae8b7a90-ea60-484c-9c2d-b4e43caf2539 service nova] Enqueued Resource ID: d9e364d3-a93f-4a56-a513-11d45b81aadf with Priority: HIGHEST for action security_group_rules [ 1093.590262] env[66502]: INFO networking_nsxv3.common.synchronization [req-ffaa90df-cbbd-4bc3-9d4c-029c1d47d48b req-ae8b7a90-ea60-484c-9c2d-b4e43caf2539 service nova] Enqueued Resource ID: d9e364d3-a93f-4a56-a513-11d45b81aadf with Priority: HIGHEST for action security_group_members [ 1093.590431] env[66502]: INFO networking_nsxv3.common.synchronization [req-ffaa90df-cbbd-4bc3-9d4c-029c1d47d48b req-ae8b7a90-ea60-484c-9c2d-b4e43caf2539 service nova] Enqueued Resource ID: 38735252-9b69-4a83-870c-b86ad0f78429 with Priority: HIGHEST for action port [ 1093.590913] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9e364d3-a93f-4a56-a513-11d45b81aadf with Priority: HIGHEST for action security_group_rules [ 1093.591577] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9e364d3-a93f-4a56-a513-11d45b81aadf with Priority: HIGHEST for action security_group_members [ 1093.591746] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 38735252-9b69-4a83-870c-b86ad0f78429 with Priority: HIGHEST for action port [ 1093.592071] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9e364d3-a93f-4a56-a513-11d45b81aadf taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.592205] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9e364d3-a93f-4a56-a513-11d45b81aadf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.592274] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9e364d3-a93f-4a56-a513-11d45b81aadf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.592527] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9e364d3-a93f-4a56-a513-11d45b81aadf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.592561] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9e364d3-a93f-4a56-a513-11d45b81aadf',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.593423] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9e364d3-a93f-4a56-a513-11d45b81aadf taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.593537] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9e364d3-a93f-4a56-a513-11d45b81aadf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.593626] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9e364d3-a93f-4a56-a513-11d45b81aadf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.593777] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9e364d3-a93f-4a56-a513-11d45b81aadf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.593926] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.594048] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.594246] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.594246] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.594322] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.594417] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9e364d3-a93f-4a56-a513-11d45b81aadf',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.595466] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-38735252-9b69-4a83-870c-b86ad0f78429 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.595587] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-38735252-9b69-4a83-870c-b86ad0f78429" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.595656] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-38735252-9b69-4a83-870c-b86ad0f78429" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.595818] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-38735252-9b69-4a83-870c-b86ad0f78429" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.595905] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('38735252-9b69-4a83-870c-b86ad0f78429',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.098645] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9e364d3-a93f-4a56-a513-11d45b81aadf taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.099107] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9e364d3-a93f-4a56-a513-11d45b81aadf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.099449] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d9e364d3-a93f-4a56-a513-11d45b81aadf',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1094.100453] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 38735252-9b69-4a83-870c-b86ad0f78429 with status ACTIVE [ 1094.100697] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.100846] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.100919] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.101197] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.101312] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.101510] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.101612] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.101676] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.101863] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.101968] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.102185] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.102282] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.102342] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.102513] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.102592] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.102676] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 38735252-9b69-4a83-870c-b86ad0f78429 is going to be updated. [ 1094.126357] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1094.126535] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1094.126620] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1094.126862] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1094.127614] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.127873] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-38735252-9b69-4a83-870c-b86ad0f78429" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.606218] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d9e364d3-a93f-4a56-a513-11d45b81aadf',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.110453] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.110453] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.110453] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.110453] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.110453] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.110453] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9e364d3-a93f-4a56-a513-11d45b81aadf is going to be created. [ 1095.164025] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.164025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.164025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.164025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.164408] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.174853] env[66502]: INFO networking_nsxv3.common.synchronization [req-dfabab08-c824-4d58-b6a0-7e3bc285e3e7 req-22a848fa-fba5-4fe7-bda4-79107d1a4458 tempest-ServerActionsTestOtherB-501490242 tempest-ServerActionsTestOtherB-501490242-project-member] Enqueued Resource ID: 670eb61a-b688-45b2-9400-64232c7b8af0 with Priority: HIGHEST for action security_group_members [ 1095.175848] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 670eb61a-b688-45b2-9400-64232c7b8af0 with Priority: HIGHEST for action security_group_members [ 1095.176867] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-670eb61a-b688-45b2-9400-64232c7b8af0 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.177023] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.177074] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.177282] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.177457] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.178213] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.178213] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.178213] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.178213] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.178213] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('670eb61a-b688-45b2-9400-64232c7b8af0',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.181970] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9e364d3-a93f-4a56-a513-11d45b81aadf in Status: UNINITIALIZED for 2s [ 1095.192978] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f796883-7322-4113-bfa9-5a64b4903a46 in Status: SUCCESS [ 1095.193644] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f796883-7322-4113-bfa9-5a64b4903a46 deletion is rescheduled due to dependency. [ 1095.193755] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.643400] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-427 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.643639] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-427" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.643817] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-427" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.644275] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-427" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.644642] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.644906] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.645098] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.645439] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.645639] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.645906] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1095.646067] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1095.646248] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1095.646869] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1095.647028] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1095.647195] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1095.647408] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1095.669898] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1095.670074] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1095.670217] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1095.670389] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-427" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.670895] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-12609ff0-afe0-44c4-8e1e-183d5554e71f taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.670895] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-12609ff0-afe0-44c4-8e1e-183d5554e71f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.671091] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-12609ff0-afe0-44c4-8e1e-183d5554e71f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.671436] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-12609ff0-afe0-44c4-8e1e-183d5554e71f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.671596] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12609ff0-afe0-44c4-8e1e-183d5554e71f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1095.681403] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.681566] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.681643] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.681826] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.681918] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.682239] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.683213] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.683324] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.687356] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.687356] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.687356] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 670eb61a-b688-45b2-9400-64232c7b8af0 is going to be updated. [ 1095.710219] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1095.710485] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1095.710545] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1095.710861] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1095.711085] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.721352] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 670eb61a-b688-45b2-9400-64232c7b8af0 in Status: IN_PROGRESS for 2s [ 1096.039610] env[66502]: INFO networking_nsxv3.common.synchronization [req-789d0d65-38b4-4b60-9e0d-76ed1262cb78 req-9c2aa19a-1a2b-41ad-8124-4d52cffced1f tempest-AttachInterfacesTestJSON-1531294335 tempest-AttachInterfacesTestJSON-1531294335-project-member] Enqueued Resource ID: ee8e701d-05aa-43ae-8307-095303edba0f with Priority: HIGHEST for action security_group_members [ 1096.039999] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee8e701d-05aa-43ae-8307-095303edba0f with Priority: HIGHEST for action security_group_members [ 1096.040449] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-ee8e701d-05aa-43ae-8307-095303edba0f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.040603] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ee8e701d-05aa-43ae-8307-095303edba0f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.040603] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ee8e701d-05aa-43ae-8307-095303edba0f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.040863] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ee8e701d-05aa-43ae-8307-095303edba0f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.041145] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.044281] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.044415] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.044587] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.044677] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.045090] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ee8e701d-05aa-43ae-8307-095303edba0f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.174207] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.174564] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.174640] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.175067] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.175247] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.175489] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port 12609ff0-afe0-44c4-8e1e-183d5554e71f not found, creating... [ 1096.175893] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.176097] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.176295] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.176542] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.176748] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.177103] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.177348] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.177557] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.177765] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.177938] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.178262] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: 12609ff0-afe0-44c4-8e1e-183d5554e71f is going to be created. [ 1096.206151] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.206151] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.206401] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.206608] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.206884] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.207127] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-12609ff0-afe0-44c4-8e1e-183d5554e71f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.547826] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.548069] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.548069] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.548254] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.571953] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.572243] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.572372] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.572429] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.572748] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.572839] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.572932] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee8e701d-05aa-43ae-8307-095303edba0f is going to be updated. [ 1096.617882] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.618049] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.618123] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.618409] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.618672] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1096.640592] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee8e701d-05aa-43ae-8307-095303edba0f in Status: IN_PROGRESS for 2s [ 1096.922845] env[66502]: INFO networking_nsxv3.common.synchronization [req-dfabab08-c824-4d58-b6a0-7e3bc285e3e7 req-647febb2-4881-46b5-ad4e-401fc50b854e service nova] Enqueued Resource ID: 670eb61a-b688-45b2-9400-64232c7b8af0 with Priority: HIGHEST for action security_group_rules [ 1096.923075] env[66502]: INFO networking_nsxv3.common.synchronization [req-dfabab08-c824-4d58-b6a0-7e3bc285e3e7 req-647febb2-4881-46b5-ad4e-401fc50b854e service nova] Enqueued Resource ID: 670eb61a-b688-45b2-9400-64232c7b8af0 with Priority: HIGHEST for action security_group_members [ 1096.923219] env[66502]: INFO networking_nsxv3.common.synchronization [req-dfabab08-c824-4d58-b6a0-7e3bc285e3e7 req-647febb2-4881-46b5-ad4e-401fc50b854e service nova] Enqueued Resource ID: 12609ff0-afe0-44c4-8e1e-183d5554e71f with Priority: HIGHEST for action port [ 1096.923913] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 670eb61a-b688-45b2-9400-64232c7b8af0 with Priority: HIGHEST for action security_group_rules [ 1096.923996] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 670eb61a-b688-45b2-9400-64232c7b8af0 with Priority: HIGHEST for action security_group_members [ 1096.924568] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12609ff0-afe0-44c4-8e1e-183d5554e71f with Priority: HIGHEST for action port [ 1096.924969] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-670eb61a-b688-45b2-9400-64232c7b8af0 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.925169] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.925283] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.925750] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.925832] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('670eb61a-b688-45b2-9400-64232c7b8af0',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1096.928247] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-670eb61a-b688-45b2-9400-64232c7b8af0 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.928396] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.928762] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-12609ff0-afe0-44c4-8e1e-183d5554e71f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1096.928963] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12609ff0-afe0-44c4-8e1e-183d5554e71f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1096.929080] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12609ff0-afe0-44c4-8e1e-183d5554e71f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1096.929329] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12609ff0-afe0-44c4-8e1e-183d5554e71f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1096.929446] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12609ff0-afe0-44c4-8e1e-183d5554e71f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.193891] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9e364d3-a93f-4a56-a513-11d45b81aadf in Status: SUCCESS [ 1097.193891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9e364d3-a93f-4a56-a513-11d45b81aadf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.193891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9e364d3-a93f-4a56-a513-11d45b81aadf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.193891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9e364d3-a93f-4a56-a513-11d45b81aadf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.193891] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.193891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.193891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.193891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.193891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.193891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9e364d3-a93f-4a56-a513-11d45b81aadf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.194606] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d9e364d3-a93f-4a56-a513-11d45b81aadf',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.431454] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-670eb61a-b688-45b2-9400-64232c7b8af0 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.431638] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.431858] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 12609ff0-afe0-44c4-8e1e-183d5554e71f with status ACTIVE [ 1097.432073] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.432207] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.432276] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.432490] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.432600] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.432785] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.432883] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.432944] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.433124] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.433204] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.433385] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.433541] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.433541] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.433690] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.433802] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.433880] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 12609ff0-afe0-44c4-8e1e-183d5554e71f is going to be updated. [ 1097.457335] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.457527] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.457568] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.457806] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.457964] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.458159] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12609ff0-afe0-44c4-8e1e-183d5554e71f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.489724] env[66502]: INFO networking_nsxv3.common.synchronization [req-39e5f9ae-8740-4afd-8dc3-5f6d89439292 req-c4e01864-6cba-4cbf-8a54-11aa1a37dbf6 tempest-ServerActionsTestJSON-2133613622 tempest-ServerActionsTestJSON-2133613622-project-member] Enqueued Resource ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 with Priority: HIGHEST for action security_group_members [ 1097.490322] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 with Priority: HIGHEST for action security_group_members [ 1097.490630] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.490754] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.490831] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.491252] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.491343] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.491429] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.491478] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.491628] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.491711] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.491808] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ab1d50c-f5a6-4aaf-829b-d0cfdf164722',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.696112] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d9e364d3-a93f-4a56-a513-11d45b81aadf',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.733766] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 670eb61a-b688-45b2-9400-64232c7b8af0 in Status: SUCCESS [ 1097.734215] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 670eb61a-b688-45b2-9400-64232c7b8af0 deletion is rescheduled due to dependency. [ 1097.734339] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.734509] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.734803] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.735108] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.735108] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.735359] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.735359] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.735359] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.735529] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('670eb61a-b688-45b2-9400-64232c7b8af0',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.836260] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-834 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.836541] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-834" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.836733] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-834" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.837053] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-834" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.837392] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.837565] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.837698] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.838044] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.838203] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.838416] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1097.838581] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1097.838778] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1097.838948] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1097.839102] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1097.839253] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1097.839400] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1097.860519] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1097.860785] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1097.861069] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1097.861289] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-834" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.861715] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-5bbafacf-3445-4ec8-9357-142c6f627c89 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.861982] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-5bbafacf-3445-4ec8-9357-142c6f627c89" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.862135] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-5bbafacf-3445-4ec8-9357-142c6f627c89" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.862545] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-5bbafacf-3445-4ec8-9357-142c6f627c89" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.862773] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5bbafacf-3445-4ec8-9357-142c6f627c89',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1097.994540] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.994767] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.994767] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.994985] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.995096] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.995301] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1097.995403] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1097.995463] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1097.995615] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1097.995695] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.995779] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 is going to be updated. [ 1098.067377] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.067578] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.067688] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.067909] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.068086] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.080992] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 in Status: IN_PROGRESS for 2s [ 1098.199037] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d9e364d3-a93f-4a56-a513-11d45b81aadf: rpc.has_security_group_logging(os_id): False [ 1098.220283] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.220550] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.220550] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.221247] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.221247] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.221247] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.221512] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.221512] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.221720] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.221855] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.221950] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9e364d3-a93f-4a56-a513-11d45b81aadf is going to be created. [ 1098.238907] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('670eb61a-b688-45b2-9400-64232c7b8af0',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1098.296891] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.297175] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.297175] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.297465] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.297700] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.344547] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9e364d3-a93f-4a56-a513-11d45b81aadf in Status: IN_PROGRESS for 2s [ 1098.367404] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.367632] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.367698] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.367988] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.368157] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.368316] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port 5bbafacf-3445-4ec8-9357-142c6f627c89 not found, creating... [ 1098.368597] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.368869] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.368997] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.369370] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.369544] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.369957] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.370150] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.370309] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.370540] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.370693] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.370848] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: 5bbafacf-3445-4ec8-9357-142c6f627c89 is going to be created. [ 1098.409555] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1098.409839] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1098.409973] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1098.410306] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1098.410575] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.410847] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-5bbafacf-3445-4ec8-9357-142c6f627c89" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.651038] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ee8e701d-05aa-43ae-8307-095303edba0f in Status: SUCCESS [ 1098.651038] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ee8e701d-05aa-43ae-8307-095303edba0f deletion is rescheduled due to dependency. [ 1098.651278] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ee8e701d-05aa-43ae-8307-095303edba0f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1098.741848] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('670eb61a-b688-45b2-9400-64232c7b8af0',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.190297] env[66502]: INFO networking_nsxv3.common.synchronization [req-39e5f9ae-8740-4afd-8dc3-5f6d89439292 req-b02e4548-8378-485e-a15e-31e5235e9548 service nova] Enqueued Resource ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 with Priority: HIGHEST for action security_group_rules [ 1099.190605] env[66502]: INFO networking_nsxv3.common.synchronization [req-39e5f9ae-8740-4afd-8dc3-5f6d89439292 req-b02e4548-8378-485e-a15e-31e5235e9548 service nova] Enqueued Resource ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 with Priority: HIGHEST for action security_group_members [ 1099.190803] env[66502]: INFO networking_nsxv3.common.synchronization [req-39e5f9ae-8740-4afd-8dc3-5f6d89439292 req-b02e4548-8378-485e-a15e-31e5235e9548 service nova] Enqueued Resource ID: 5bbafacf-3445-4ec8-9357-142c6f627c89 with Priority: HIGHEST for action port [ 1099.191567] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 with Priority: HIGHEST for action security_group_rules [ 1099.191719] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 with Priority: HIGHEST for action security_group_members [ 1099.191818] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5bbafacf-3445-4ec8-9357-142c6f627c89 with Priority: HIGHEST for action port [ 1099.192236] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.192236] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.192352] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.192649] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.192649] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ab1d50c-f5a6-4aaf-829b-d0cfdf164722',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.194075] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.194075] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.194075] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-5bbafacf-3445-4ec8-9357-142c6f627c89 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.194075] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5bbafacf-3445-4ec8-9357-142c6f627c89" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.194075] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5bbafacf-3445-4ec8-9357-142c6f627c89" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.194382] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5bbafacf-3445-4ec8-9357-142c6f627c89" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.194382] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5bbafacf-3445-4ec8-9357-142c6f627c89',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1099.244149] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.244623] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.244623] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.244866] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.244975] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.245082] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 670eb61a-b688-45b2-9400-64232c7b8af0 is going to be updated. [ 1099.278283] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.278417] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.278516] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.278771] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.278936] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.289998] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 670eb61a-b688-45b2-9400-64232c7b8af0 in Status: IN_PROGRESS for 2s [ 1099.695579] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.695932] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.696254] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5bbafacf-3445-4ec8-9357-142c6f627c89 with status ACTIVE [ 1099.696653] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.696893] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.697023] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.697330] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.697492] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.697816] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.698065] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.698161] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.698515] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.698697] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.699163] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.699380] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.699539] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.699787] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.699975] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.700153] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5bbafacf-3445-4ec8-9357-142c6f627c89 is going to be updated. [ 1099.726355] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1099.726652] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1099.726652] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1099.726934] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1099.727124] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1099.727319] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5bbafacf-3445-4ec8-9357-142c6f627c89" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.024119] env[66502]: INFO networking_nsxv3.common.synchronization [req-c7a5c995-27d6-40bb-9138-7abd1bbb6a6a req-11947f83-e6d5-4ef7-9e2f-aa30f7e1ff59 tempest-ListImageFiltersTestJSON-1337315773 tempest-ListImageFiltersTestJSON-1337315773-project-member] Enqueued Resource ID: 4fcd5f21-1906-475c-9571-24c419ac05d8 with Priority: HIGHEST for action security_group_members [ 1100.024119] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fcd5f21-1906-475c-9571-24c419ac05d8 with Priority: HIGHEST for action security_group_members [ 1100.024119] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fcd5f21-1906-475c-9571-24c419ac05d8 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.024418] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.024418] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.024581] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.025447] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.025447] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.025447] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.025447] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.025447] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.025447] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fcd5f21-1906-475c-9571-24c419ac05d8',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.099926] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 in Status: SUCCESS [ 1100.100132] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 deletion is rescheduled due to dependency. [ 1100.100211] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.100402] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.100702] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.101248] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.101454] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.101549] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.101796] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.101916] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.102064] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ab1d50c-f5a6-4aaf-829b-d0cfdf164722',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.372301] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d9e364d3-a93f-4a56-a513-11d45b81aadf in Status: SUCCESS [ 1100.373018] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9e364d3-a93f-4a56-a513-11d45b81aadf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.456289] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-670 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.456580] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.456633] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.456922] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.457211] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.457382] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.457499] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.457716] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.457860] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.458080] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1100.458192] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1100.458298] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1100.458407] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1100.458513] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1100.458617] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1100.458777] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1100.477450] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1100.477652] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1100.477752] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1100.477928] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.478263] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-192c6d9b-d8fb-4fbb-9fd7-6da4baa9aaed taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.478469] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-192c6d9b-d8fb-4fbb-9fd7-6da4baa9aaed" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.478543] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-192c6d9b-d8fb-4fbb-9fd7-6da4baa9aaed" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.479164] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-192c6d9b-d8fb-4fbb-9fd7-6da4baa9aaed" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.479234] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('192c6d9b-d8fb-4fbb-9fd7-6da4baa9aaed',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.529401] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.529595] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.529714] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.530153] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.530255] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.530489] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.530602] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.530683] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.530909] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.531264] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.531453] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fcd5f21-1906-475c-9571-24c419ac05d8 already deleted. [ 1100.531618] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.604890] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8ab1d50c-f5a6-4aaf-829b-d0cfdf164722',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1100.983430] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.983743] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.983899] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.984279] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.984482] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.984980] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 192c6d9b-d8fb-4fbb-9fd7-6da4baa9aaed not found, creating... [ 1100.985157] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.985318] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.985399] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.985640] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.985793] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.986116] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.986307] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.986427] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.986671] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.986825] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.986964] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 192c6d9b-d8fb-4fbb-9fd7-6da4baa9aaed is going to be created. [ 1101.010259] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.010644] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.010862] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.011499] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.011926] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.012324] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-192c6d9b-d8fb-4fbb-9fd7-6da4baa9aaed" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.107580] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8ab1d50c-f5a6-4aaf-829b-d0cfdf164722',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.302873] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 670eb61a-b688-45b2-9400-64232c7b8af0 in Status: SUCCESS [ 1101.303212] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.303389] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.303636] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.303869] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.304285] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.304285] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.304285] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.304285] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.304454] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.304511] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('670eb61a-b688-45b2-9400-64232c7b8af0',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.613811] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.613811] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.613811] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.613811] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.613811] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.613811] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 is going to be updated. [ 1101.685666] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.685666] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.685666] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.685666] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.685666] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.694971] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 in Status: IN_PROGRESS for 2s [ 1101.756833] env[66502]: INFO networking_nsxv3.common.synchronization [req-c7a5c995-27d6-40bb-9138-7abd1bbb6a6a req-3c79da2d-a721-4f07-a193-78a7cabe3187 service nova] Enqueued Resource ID: 4fcd5f21-1906-475c-9571-24c419ac05d8 with Priority: HIGHEST for action security_group_rules [ 1101.756833] env[66502]: INFO networking_nsxv3.common.synchronization [req-c7a5c995-27d6-40bb-9138-7abd1bbb6a6a req-3c79da2d-a721-4f07-a193-78a7cabe3187 service nova] Enqueued Resource ID: 4fcd5f21-1906-475c-9571-24c419ac05d8 with Priority: HIGHEST for action security_group_members [ 1101.756833] env[66502]: INFO networking_nsxv3.common.synchronization [req-c7a5c995-27d6-40bb-9138-7abd1bbb6a6a req-3c79da2d-a721-4f07-a193-78a7cabe3187 service nova] Enqueued Resource ID: 192c6d9b-d8fb-4fbb-9fd7-6da4baa9aaed with Priority: HIGHEST for action port [ 1101.756833] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fcd5f21-1906-475c-9571-24c419ac05d8 with Priority: HIGHEST for action security_group_rules [ 1101.756833] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fcd5f21-1906-475c-9571-24c419ac05d8 with Priority: HIGHEST for action security_group_members [ 1101.758677] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 192c6d9b-d8fb-4fbb-9fd7-6da4baa9aaed with Priority: HIGHEST for action port [ 1101.759494] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fcd5f21-1906-475c-9571-24c419ac05d8 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.759727] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.759839] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.760096] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.760211] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fcd5f21-1906-475c-9571-24c419ac05d8',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.761882] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fcd5f21-1906-475c-9571-24c419ac05d8 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.762060] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.762156] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.762531] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.762606] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.762719] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.762809] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.764366] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.764366] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.764366] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fcd5f21-1906-475c-9571-24c419ac05d8',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.765341] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-192c6d9b-d8fb-4fbb-9fd7-6da4baa9aaed taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.765341] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-192c6d9b-d8fb-4fbb-9fd7-6da4baa9aaed" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.765341] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-192c6d9b-d8fb-4fbb-9fd7-6da4baa9aaed" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.765341] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-192c6d9b-d8fb-4fbb-9fd7-6da4baa9aaed" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.765610] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('192c6d9b-d8fb-4fbb-9fd7-6da4baa9aaed',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.807812] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('670eb61a-b688-45b2-9400-64232c7b8af0',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.263152] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fcd5f21-1906-475c-9571-24c419ac05d8 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.263431] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.271469] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4fcd5f21-1906-475c-9571-24c419ac05d8',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.273237] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 192c6d9b-d8fb-4fbb-9fd7-6da4baa9aaed with status ACTIVE [ 1102.273580] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.273580] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.274100] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.274100] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.274100] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.274100] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.274367] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.274367] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.274564] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.274564] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.274703] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.274800] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.274870] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.275100] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.275100] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.275299] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 192c6d9b-d8fb-4fbb-9fd7-6da4baa9aaed is going to be updated. [ 1102.307190] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.307419] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.307487] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.308254] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.308395] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.308586] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-192c6d9b-d8fb-4fbb-9fd7-6da4baa9aaed" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.309849] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 670eb61a-b688-45b2-9400-64232c7b8af0: rpc.has_security_group_logging(os_id): False [ 1102.330932] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.331221] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.331294] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.333337] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.333337] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.333337] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.333337] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.333337] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.333337] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.333337] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.333337] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 670eb61a-b688-45b2-9400-64232c7b8af0 is going to be updated. [ 1102.436461] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.436679] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.436679] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.436918] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.437106] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.457152] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 670eb61a-b688-45b2-9400-64232c7b8af0 in Status: IN_PROGRESS for 2s [ 1102.537839] env[66502]: INFO networking_nsxv3.common.synchronization [req-c9ce1281-74c6-4ee4-8a35-12f7189fc01c req-86f433ff-4b78-49f7-b4b8-e1360bb661d9 tempest-ListImageFiltersTestJSON-1337315773 tempest-ListImageFiltersTestJSON-1337315773-project-member] Enqueued Resource ID: 4fcd5f21-1906-475c-9571-24c419ac05d8 with Priority: HIGHEST for action security_group_members [ 1102.537839] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fcd5f21-1906-475c-9571-24c419ac05d8 with Priority: HIGHEST for action security_group_members [ 1102.537839] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fcd5f21-1906-475c-9571-24c419ac05d8 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.537839] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.777827] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4fcd5f21-1906-475c-9571-24c419ac05d8',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1102.852053] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-670 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.852338] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.852493] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.852824] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.853137] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.853362] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.853509] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.853770] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.853965] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.854230] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1102.854367] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1102.854501] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1102.854645] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1102.854787] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1102.854915] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1102.855075] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1102.875532] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1102.875724] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1102.875889] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1102.876115] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-670" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1102.876476] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-f77914a4-898b-4c92-a705-35e86e6be527 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1102.876734] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-f77914a4-898b-4c92-a705-35e86e6be527" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1102.876872] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-f77914a4-898b-4c92-a705-35e86e6be527" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1102.877233] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-f77914a4-898b-4c92-a705-35e86e6be527" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1102.877400] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f77914a4-898b-4c92-a705-35e86e6be527',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1103.281039] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.281235] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.281338] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.281573] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.281701] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.281800] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fcd5f21-1906-475c-9571-24c419ac05d8 is going to be created. [ 1103.342109] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.342351] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.342351] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.342564] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.342721] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.355895] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fcd5f21-1906-475c-9571-24c419ac05d8 in Status: UNINITIALIZED for 2s [ 1103.380379] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.380793] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.380997] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.381369] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.381556] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.381722] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port f77914a4-898b-4c92-a705-35e86e6be527 not found, creating... [ 1103.382093] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.382306] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.382444] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.382736] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.382915] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.383278] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.383475] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.383608] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.383853] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.384042] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.384195] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: f77914a4-898b-4c92-a705-35e86e6be527 is going to be created. [ 1103.411970] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.412319] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.412669] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.412844] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.413028] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.413328] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-f77914a4-898b-4c92-a705-35e86e6be527" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.706911] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 in Status: SUCCESS [ 1103.707272] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.707550] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.707880] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.708199] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1103.708366] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1103.708448] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1103.708631] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1103.708721] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.708863] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1103.709046] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8ab1d50c-f5a6-4aaf-829b-d0cfdf164722',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.212734] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8ab1d50c-f5a6-4aaf-829b-d0cfdf164722',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.215960] env[66502]: INFO networking_nsxv3.common.synchronization [req-c9ce1281-74c6-4ee4-8a35-12f7189fc01c req-e9aa1b52-3483-4da2-8edb-ceedc3c5be6a service nova] Enqueued Resource ID: 4fcd5f21-1906-475c-9571-24c419ac05d8 with Priority: HIGHEST for action security_group_rules [ 1104.216052] env[66502]: INFO networking_nsxv3.common.synchronization [req-c9ce1281-74c6-4ee4-8a35-12f7189fc01c req-e9aa1b52-3483-4da2-8edb-ceedc3c5be6a service nova] Enqueued Resource ID: 4fcd5f21-1906-475c-9571-24c419ac05d8 with Priority: HIGHEST for action security_group_members [ 1104.216396] env[66502]: INFO networking_nsxv3.common.synchronization [req-c9ce1281-74c6-4ee4-8a35-12f7189fc01c req-e9aa1b52-3483-4da2-8edb-ceedc3c5be6a service nova] Enqueued Resource ID: f77914a4-898b-4c92-a705-35e86e6be527 with Priority: HIGHEST for action port [ 1104.216554] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fcd5f21-1906-475c-9571-24c419ac05d8 with Priority: HIGHEST for action security_group_rules [ 1104.216617] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fcd5f21-1906-475c-9571-24c419ac05d8 with Priority: HIGHEST for action security_group_members [ 1104.216727] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f77914a4-898b-4c92-a705-35e86e6be527 with Priority: HIGHEST for action port [ 1104.217424] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4fcd5f21-1906-475c-9571-24c419ac05d8 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.217571] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.217892] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fcd5f21-1906-475c-9571-24c419ac05d8 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.218058] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.218281] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-f77914a4-898b-4c92-a705-35e86e6be527 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.218429] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f77914a4-898b-4c92-a705-35e86e6be527" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.218510] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f77914a4-898b-4c92-a705-35e86e6be527" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.218899] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f77914a4-898b-4c92-a705-35e86e6be527" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.218899] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f77914a4-898b-4c92-a705-35e86e6be527',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.486052] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 670eb61a-b688-45b2-9400-64232c7b8af0 in Status: SUCCESS [ 1104.486283] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.717071] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722: rpc.has_security_group_logging(os_id): False [ 1104.723332] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f77914a4-898b-4c92-a705-35e86e6be527 with status ACTIVE [ 1104.723332] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.723332] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.723332] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.723332] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.723788] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.723788] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.723788] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.723788] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.723987] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.723987] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.724201] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.724297] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.724361] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.724521] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.724609] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.724695] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f77914a4-898b-4c92-a705-35e86e6be527 is going to be updated. [ 1104.730619] env[66502]: INFO networking_nsxv3.common.synchronization [req-2afb98b3-bf5f-43b0-95a8-b94e0bf867a6 req-59e74445-cc5e-4f9f-8162-0e7f9119a360 tempest-ImagesOneServerTestJSON-1215519078 tempest-ImagesOneServerTestJSON-1215519078-project-member] Enqueued Resource ID: a469cf90-b952-424a-940b-c195857fb6f2 with Priority: HIGHEST for action security_group_members [ 1104.732417] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a469cf90-b952-424a-940b-c195857fb6f2 with Priority: HIGHEST for action security_group_members [ 1104.732417] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-a469cf90-b952-424a-940b-c195857fb6f2 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.732417] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a469cf90-b952-424a-940b-c195857fb6f2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.732417] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a469cf90-b952-424a-940b-c195857fb6f2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.732417] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a469cf90-b952-424a-940b-c195857fb6f2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.732417] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.732417] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.732417] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.732979] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.732979] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.732979] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a469cf90-b952-424a-940b-c195857fb6f2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1104.754754] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.754931] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.755306] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.755566] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.755663] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.755916] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.756050] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.756120] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.756279] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.756358] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.756456] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 is going to be updated. [ 1104.763165] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.763494] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.763494] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.763723] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.763908] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.764378] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f77914a4-898b-4c92-a705-35e86e6be527" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.935039] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.935307] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.935385] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.935578] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.935706] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.967893] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 in Status: IN_PROGRESS for 2s [ 1104.993198] env[66502]: INFO networking_nsxv3.common.synchronization [req-4af8a9d2-371b-4158-ba3f-be2abf0d5750 req-d5380708-e2ab-4b0a-95ad-79bdb3a03828 tempest-ServerDiskConfigTestJSON-940033598 tempest-ServerDiskConfigTestJSON-940033598-project-member] Enqueued Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGHEST for action security_group_members [ 1104.993822] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGHEST for action security_group_members [ 1104.994149] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-aba51398-48dc-4f5e-b3cf-1da4130d58fb taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.994292] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.994377] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.994545] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.994705] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1104.994789] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1104.994928] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1104.995012] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1104.999303] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1104.999505] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.235633] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.236038] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.236038] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.236134] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.236228] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.236448] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.236550] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.236614] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.236849] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.236965] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.237079] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a469cf90-b952-424a-940b-c195857fb6f2 is going to be updated. [ 1105.273945] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.274111] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.274181] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.274483] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.274631] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.286524] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a469cf90-b952-424a-940b-c195857fb6f2 in Status: IN_PROGRESS for 2s [ 1105.367103] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fcd5f21-1906-475c-9571-24c419ac05d8 in Status: SUCCESS [ 1105.367604] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.367604] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.367786] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.367859] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.367958] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.368046] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.368230] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.368230] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.368394] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.368394] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4fcd5f21-1906-475c-9571-24c419ac05d8',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.370826] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.371771] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.373308] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.373308] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.373308] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.373308] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.373308] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.373308] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fcd5f21-1906-475c-9571-24c419ac05d8',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.377581] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-509 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.377581] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-509" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.378108] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-509" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.378108] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-509" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.378482] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.378718] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.378969] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.379342] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.379696] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.380061] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1105.380203] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1105.380362] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1105.380512] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1105.380727] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1105.380924] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1105.381085] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1105.405519] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1105.405860] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1105.406068] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1105.406331] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-509" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.406706] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-432ded57-918b-456e-88e2-91e29d0eaef0 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.406962] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-432ded57-918b-456e-88e2-91e29d0eaef0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.407187] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-432ded57-918b-456e-88e2-91e29d0eaef0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.407569] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-432ded57-918b-456e-88e2-91e29d0eaef0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.407982] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('432ded57-918b-456e-88e2-91e29d0eaef0',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.502474] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.502691] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.502795] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.503124] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.503209] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.503409] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.503512] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.503566] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.503712] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.503783] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.503864] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb is going to be updated. [ 1105.531367] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.531528] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.531587] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.531799] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.531940] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.542424] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb in Status: IN_PROGRESS for 2s [ 1105.875371] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4fcd5f21-1906-475c-9571-24c419ac05d8',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1105.877178] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fcd5f21-1906-475c-9571-24c419ac05d8 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.877301] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.914162] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.914433] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.914567] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.914850] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.915000] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.915165] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 432ded57-918b-456e-88e2-91e29d0eaef0 not found, creating... [ 1105.915493] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.915691] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.915826] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.916062] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.916212] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.916551] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.916689] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.916829] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.917046] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.917259] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.917443] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 432ded57-918b-456e-88e2-91e29d0eaef0 is going to be created. [ 1105.941241] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1105.941519] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1105.941678] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1105.942009] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1105.942249] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.942522] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-432ded57-918b-456e-88e2-91e29d0eaef0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.379965] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4fcd5f21-1906-475c-9571-24c419ac05d8',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.781764] env[66502]: INFO networking_nsxv3.common.synchronization [req-4af8a9d2-371b-4158-ba3f-be2abf0d5750 req-4e3cb5b5-4139-4dbe-8c96-bf34607f15d1 service nova] Enqueued Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGHEST for action security_group_rules [ 1106.781932] env[66502]: INFO networking_nsxv3.common.synchronization [req-4af8a9d2-371b-4158-ba3f-be2abf0d5750 req-4e3cb5b5-4139-4dbe-8c96-bf34607f15d1 service nova] Enqueued Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGHEST for action security_group_members [ 1106.782113] env[66502]: INFO networking_nsxv3.common.synchronization [req-4af8a9d2-371b-4158-ba3f-be2abf0d5750 req-4e3cb5b5-4139-4dbe-8c96-bf34607f15d1 service nova] Enqueued Resource ID: 432ded57-918b-456e-88e2-91e29d0eaef0 with Priority: HIGHEST for action port [ 1106.782702] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGHEST for action security_group_rules [ 1106.782972] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGHEST for action security_group_members [ 1106.782972] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 432ded57-918b-456e-88e2-91e29d0eaef0 with Priority: HIGHEST for action port [ 1106.783767] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aba51398-48dc-4f5e-b3cf-1da4130d58fb taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.784355] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.784355] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.784355] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.784355] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.785872] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-aba51398-48dc-4f5e-b3cf-1da4130d58fb taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.785947] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.786185] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-432ded57-918b-456e-88e2-91e29d0eaef0 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.786291] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-432ded57-918b-456e-88e2-91e29d0eaef0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.786357] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-432ded57-918b-456e-88e2-91e29d0eaef0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.786548] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-432ded57-918b-456e-88e2-91e29d0eaef0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.786630] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('432ded57-918b-456e-88e2-91e29d0eaef0',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1106.882676] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.882836] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.882904] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.883154] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.883249] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.883355] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fcd5f21-1906-475c-9571-24c419ac05d8 is going to be updated. [ 1106.912482] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.912669] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.912754] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.913265] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.913482] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.923447] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fcd5f21-1906-475c-9571-24c419ac05d8 in Status: IN_PROGRESS for 2s [ 1106.982388] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 in Status: SUCCESS [ 1106.982676] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.288797] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-aba51398-48dc-4f5e-b3cf-1da4130d58fb taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.289031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.290834] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 432ded57-918b-456e-88e2-91e29d0eaef0 with status ACTIVE [ 1107.291121] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.291301] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.291380] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.291611] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.292230] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.292230] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.292230] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.292230] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.292621] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.292621] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.292697] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.292793] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.292866] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.293367] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.293367] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.293367] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 432ded57-918b-456e-88e2-91e29d0eaef0 is going to be updated. [ 1107.297733] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a469cf90-b952-424a-940b-c195857fb6f2 in Status: SUCCESS [ 1107.298389] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a469cf90-b952-424a-940b-c195857fb6f2 deletion is rescheduled due to dependency. [ 1107.298389] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a469cf90-b952-424a-940b-c195857fb6f2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.316153] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.316357] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.316405] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.316596] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.316741] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.316920] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-432ded57-918b-456e-88e2-91e29d0eaef0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.552520] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb in Status: SUCCESS [ 1107.552793] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb deletion is rescheduled due to dependency. [ 1107.552793] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.552967] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.553248] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.553522] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.553587] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.553627] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.553759] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.553839] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.553934] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.056359] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.559511] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.937389] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fcd5f21-1906-475c-9571-24c419ac05d8 in Status: SUCCESS [ 1108.937634] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.937864] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.938216] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.938453] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.938607] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.938692] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.939018] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.939158] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.939306] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fcd5f21-1906-475c-9571-24c419ac05d8',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.062440] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.062613] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.062613] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.062826] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.062921] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.063043] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb is going to be updated. [ 1109.092037] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.092187] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.092261] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.092470] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.092751] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.102076] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb in Status: IN_PROGRESS for 2s [ 1109.442786] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4fcd5f21-1906-475c-9571-24c419ac05d8',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.949075] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4fcd5f21-1906-475c-9571-24c419ac05d8',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.451415] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.455016] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.455016] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.455016] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.455016] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.455016] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fcd5f21-1906-475c-9571-24c419ac05d8 is going to be updated. [ 1110.488259] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.488259] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.488259] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.488259] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.488259] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.500425] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fcd5f21-1906-475c-9571-24c419ac05d8 in Status: IN_PROGRESS for 2s [ 1111.115530] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb in Status: SUCCESS [ 1111.115922] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.116109] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.116330] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.116531] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.116654] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.116716] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.116886] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.116986] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.117071] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.117168] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.367112] env[66502]: INFO networking_nsxv3.common.synchronization [req-7b7adbcb-f721-4dd8-8751-9063eeeb5a51 req-ed803624-5958-49a5-92f3-517fe17fee04 tempest-ServersTestJSON-1210226259 tempest-ServersTestJSON-1210226259-project-member] Enqueued Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_members [ 1111.368101] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_members [ 1111.368101] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.368412] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.368412] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.368563] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.368611] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.368702] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.368753] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.368909] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.369025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.369139] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.621526] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-aba51398-48dc-4f5e-b3cf-1da4130d58fb taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.621526] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.621910] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.622361] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.622649] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.622870] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.622976] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.623330] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.623456] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.623557] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.623741] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-aba51398-48dc-4f5e-b3cf-1da4130d58fb taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.623847] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.623942] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.624550] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.624550] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.624550] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.624707] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.625037] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.625037] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.625037] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.625037] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.697162] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-708 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.697366] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-708" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.697512] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-708" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.697749] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-708" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.698231] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.698418] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.698536] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.698761] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.698904] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.699167] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1111.699306] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1111.699418] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1111.699526] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1111.699637] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1111.699740] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1111.699868] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1111.723624] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1111.723805] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1111.723937] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1111.724203] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-708" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.724473] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-de682558-2088-49b7-a2dd-da6519fc4c23 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.724660] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-de682558-2088-49b7-a2dd-da6519fc4c23" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.724773] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-de682558-2088-49b7-a2dd-da6519fc4c23" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.725191] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-de682558-2088-49b7-a2dd-da6519fc4c23" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.725318] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de682558-2088-49b7-a2dd-da6519fc4c23',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.870869] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.128481] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for aba51398-48dc-4f5e-b3cf-1da4130d58fb: rpc.has_security_group_logging(os_id): False [ 1112.152703] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.152703] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.152703] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.152932] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.152932] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.153194] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.153293] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.153363] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.153520] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.153638] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.154249] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.154249] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.154249] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.154249] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.154249] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.154469] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.154469] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.154469] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.154599] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.154672] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.154714] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb is going to be updated. [ 1112.216051] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.216051] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.216051] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.216051] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.216051] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.228555] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.229147] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.229147] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.229412] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.229576] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.229735] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port de682558-2088-49b7-a2dd-da6519fc4c23 not found, creating... [ 1112.230181] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.230373] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.230511] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.230746] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.230884] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.231199] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.231377] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.231497] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.231704] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.231836] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.231974] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: de682558-2088-49b7-a2dd-da6519fc4c23 is going to be created. [ 1112.233718] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb in Status: IN_PROGRESS for 2s [ 1112.263346] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.263621] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.263682] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.263981] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.264230] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.264465] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-de682558-2088-49b7-a2dd-da6519fc4c23" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.373811] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.510387] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fcd5f21-1906-475c-9571-24c419ac05d8 in Status: SUCCESS [ 1112.510727] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.510996] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.511345] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.511656] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.511841] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.511945] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.512354] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.512483] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.512614] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.512848] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fcd5f21-1906-475c-9571-24c419ac05d8 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.512992] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.513099] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.513306] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.513525] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.513660] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.513752] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.513949] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.514094] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.514438] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.514621] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4fcd5f21-1906-475c-9571-24c419ac05d8',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.878643] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.878856] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.878928] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.879263] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.879386] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.879490] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d226a97-2d69-4706-b98b-565700008c6f is going to be updated. [ 1112.918280] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.918533] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.918612] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.918905] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.919159] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.930543] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: IN_PROGRESS for 2s [ 1113.017278] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4fcd5f21-1906-475c-9571-24c419ac05d8: rpc.has_security_group_logging(os_id): False [ 1113.037067] env[66502]: INFO networking_nsxv3.common.synchronization [req-7b7adbcb-f721-4dd8-8751-9063eeeb5a51 req-18f59178-bcbe-4dd2-9f83-194119e2a1da service nova] Enqueued Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_rules [ 1113.037714] env[66502]: INFO networking_nsxv3.common.synchronization [req-7b7adbcb-f721-4dd8-8751-9063eeeb5a51 req-18f59178-bcbe-4dd2-9f83-194119e2a1da service nova] Enqueued Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_members [ 1113.037714] env[66502]: INFO networking_nsxv3.common.synchronization [req-7b7adbcb-f721-4dd8-8751-9063eeeb5a51 req-18f59178-bcbe-4dd2-9f83-194119e2a1da service nova] Enqueued Resource ID: de682558-2088-49b7-a2dd-da6519fc4c23 with Priority: HIGHEST for action port [ 1113.038806] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_rules [ 1113.038953] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_members [ 1113.039275] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de682558-2088-49b7-a2dd-da6519fc4c23 with Priority: HIGHEST for action port [ 1113.041383] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.042450] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.042566] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.042856] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.044414] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.044662] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.044808] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.044868] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.045317] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.045474] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.045782] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.045903] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.045962] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.046207] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.046301] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.046551] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.046650] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.046716] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.046910] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.046992] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.047802] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fcd5f21-1906-475c-9571-24c419ac05d8 is going to be created. [ 1113.049367] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.049597] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.049721] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.049948] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.050119] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.051948] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.052909] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.053470] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-de682558-2088-49b7-a2dd-da6519fc4c23 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.054427] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de682558-2088-49b7-a2dd-da6519fc4c23" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.054678] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de682558-2088-49b7-a2dd-da6519fc4c23" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.055013] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de682558-2088-49b7-a2dd-da6519fc4c23" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.055446] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de682558-2088-49b7-a2dd-da6519fc4c23',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1113.129037] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.129466] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.129466] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.129466] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.129651] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.140057] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fcd5f21-1906-475c-9571-24c419ac05d8 in Status: IN_PROGRESS for 2s [ 1113.562035] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.562035] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.562035] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port de682558-2088-49b7-a2dd-da6519fc4c23 with status ACTIVE [ 1113.562035] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.562035] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.562035] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.562035] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.562035] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.562035] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.562035] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.562035] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.562035] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.562843] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.563248] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.563547] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.563969] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.564369] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.564649] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.565106] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: de682558-2088-49b7-a2dd-da6519fc4c23 is going to be updated. [ 1113.598062] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.598062] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.598062] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.598062] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.598062] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.598062] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de682558-2088-49b7-a2dd-da6519fc4c23" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.695253] env[66502]: INFO networking_nsxv3.common.synchronization [req-cc571298-0e36-494b-9fa0-baf8946a7898 req-b473adc4-70c7-4f8e-8c2d-f6f1a684599e tempest-DeleteServersTestJSON-51385704 tempest-DeleteServersTestJSON-51385704-project-member] Enqueued Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_members [ 1113.695253] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_members [ 1113.696055] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-704e5eab-aa44-4493-8c9a-0b24250e7bea taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.698231] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.698231] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.698231] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.698231] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.698231] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.698231] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.698231] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.698231] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.698231] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.105061] env[66502]: INFO networking_nsxv3.common.synchronization [None req-8e23d70c-fe65-49b1-8aea-06f601333957 None None] Enqueued Resource ID: 178b0c36-140f-42ca-8c94-2abf2f4268cb with Priority: HIGHEST for action port [ 1114.107379] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 178b0c36-140f-42ca-8c94-2abf2f4268cb with Priority: HIGHEST for action port [ 1114.107379] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-178b0c36-140f-42ca-8c94-2abf2f4268cb taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.108476] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-178b0c36-140f-42ca-8c94-2abf2f4268cb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.108476] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-178b0c36-140f-42ca-8c94-2abf2f4268cb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.109592] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-178b0c36-140f-42ca-8c94-2abf2f4268cb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.109848] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('178b0c36-140f-42ca-8c94-2abf2f4268cb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.147645] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-608 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.148147] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-608" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.148147] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-608" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.148280] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-608" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.148498] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.148656] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.148774] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.148983] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.149228] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.149443] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1114.149556] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1114.149669] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1114.149778] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1114.149886] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1114.149995] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1114.150182] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1114.171036] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1114.171206] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1114.171366] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1114.171564] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-608" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.171896] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-0d620319-8c72-4884-ad6a-0bbd9fb4a432 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.172110] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-0d620319-8c72-4884-ad6a-0bbd9fb4a432" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.172216] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-0d620319-8c72-4884-ad6a-0bbd9fb4a432" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.172510] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-0d620319-8c72-4884-ad6a-0bbd9fb4a432" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.172646] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d620319-8c72-4884-ad6a-0bbd9fb4a432',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.203734] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.203734] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.203734] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.203734] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.203734] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.203734] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.203734] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.203734] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.203734] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.203734] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.203734] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea is going to be updated. [ 1114.231569] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.231795] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.231795] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.232016] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.232165] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.242989] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: IN_PROGRESS for 2s [ 1114.248654] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb in Status: SUCCESS [ 1114.249565] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.612917] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 178b0c36-140f-42ca-8c94-2abf2f4268cb [ 1114.613265] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.613478] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.613596] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.613917] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.614106] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.614280] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:178b0c36-140f-42ca-8c94-2abf2f4268cb already deleted. [ 1114.614434] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-178b0c36-140f-42ca-8c94-2abf2f4268cb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.675197] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.675478] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.675544] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.675969] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.675969] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.676230] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port 0d620319-8c72-4884-ad6a-0bbd9fb4a432 not found, creating... [ 1114.676489] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.676648] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.676796] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.677338] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.677338] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.677654] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.678010] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.678189] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.678433] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.678576] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.678719] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: 0d620319-8c72-4884-ad6a-0bbd9fb4a432 is going to be created. [ 1114.700529] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.700822] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.700891] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.701177] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.701412] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.701634] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-0d620319-8c72-4884-ad6a-0bbd9fb4a432" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.942702] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: SUCCESS [ 1114.942832] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.943011] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.943240] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.943427] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.943546] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.943612] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.943783] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.943867] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.943962] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.143843] env[66502]: INFO networking_nsxv3.common.synchronization [None req-99af00b5-ef29-4a35-80ba-464e7e852449 tempest-ServerActionsTestOtherA-1204678764 tempest-ServerActionsTestOtherA-1204678764-project-member] Enqueued Resource ID: 8778c764-50b3-4305-af4e-70e2f924392d with Priority: HIGHEST for action security_group_rules [ 1115.144447] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8778c764-50b3-4305-af4e-70e2f924392d with Priority: HIGHEST for action security_group_rules [ 1115.145314] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8778c764-50b3-4305-af4e-70e2f924392d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.145450] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.145526] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.145789] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.145873] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8778c764-50b3-4305-af4e-70e2f924392d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.158153] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fcd5f21-1906-475c-9571-24c419ac05d8 in Status: SUCCESS [ 1115.158446] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.158562] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.158819] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.158913] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4fcd5f21-1906-475c-9571-24c419ac05d8',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.333968] env[66502]: INFO networking_nsxv3.common.synchronization [None req-90998ad0-9a13-43bf-b172-56eb06ce1f99 tempest-ServerActionsTestOtherA-1204678764 tempest-ServerActionsTestOtherA-1204678764-project-member] Enqueued Resource ID: 8778c764-50b3-4305-af4e-70e2f924392d with Priority: HIGHEST for action security_group_rules [ 1115.335163] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8778c764-50b3-4305-af4e-70e2f924392d with Priority: HIGHEST for action security_group_rules [ 1115.335163] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8778c764-50b3-4305-af4e-70e2f924392d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.335163] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.450944] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.537147] env[66502]: INFO networking_nsxv3.common.synchronization [req-cc571298-0e36-494b-9fa0-baf8946a7898 req-4f634f6d-f707-4f5d-91fe-7134f11d551c service nova] Enqueued Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_rules [ 1115.537391] env[66502]: INFO networking_nsxv3.common.synchronization [req-cc571298-0e36-494b-9fa0-baf8946a7898 req-4f634f6d-f707-4f5d-91fe-7134f11d551c service nova] Enqueued Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_members [ 1115.537498] env[66502]: INFO networking_nsxv3.common.synchronization [req-cc571298-0e36-494b-9fa0-baf8946a7898 req-4f634f6d-f707-4f5d-91fe-7134f11d551c service nova] Enqueued Resource ID: 0d620319-8c72-4884-ad6a-0bbd9fb4a432 with Priority: HIGHEST for action port [ 1115.538078] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_rules [ 1115.538228] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_members [ 1115.538327] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d620319-8c72-4884-ad6a-0bbd9fb4a432 with Priority: HIGHEST for action port [ 1115.538618] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-704e5eab-aa44-4493-8c9a-0b24250e7bea taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.538741] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.538808] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.539020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.539161] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.540496] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-704e5eab-aa44-4493-8c9a-0b24250e7bea taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.540630] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.540859] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-0d620319-8c72-4884-ad6a-0bbd9fb4a432 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.540964] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0d620319-8c72-4884-ad6a-0bbd9fb4a432" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.541165] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0d620319-8c72-4884-ad6a-0bbd9fb4a432" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.541367] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0d620319-8c72-4884-ad6a-0bbd9fb4a432" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.541456] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0d620319-8c72-4884-ad6a-0bbd9fb4a432',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.664543] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fcd5f21-1906-475c-9571-24c419ac05d8 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.664713] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.664760] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.664981] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.665162] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.665263] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.665325] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.665476] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.665559] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.665646] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.665730] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4fcd5f21-1906-475c-9571-24c419ac05d8',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.670243] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.670426] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.670538] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.670861] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.671561] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.671692] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8778c764-50b3-4305-af4e-70e2f924392d already deleted. [ 1115.671808] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.672448] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.672628] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.672738] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8778c764-50b3-4305-af4e-70e2f924392d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.955810] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.044694] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-704e5eab-aa44-4493-8c9a-0b24250e7bea taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.044903] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.045040] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0d620319-8c72-4884-ad6a-0bbd9fb4a432 with status ACTIVE [ 1116.045219] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.045327] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.045392] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.045594] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.045683] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.045861] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.045956] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.046031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.046195] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.046337] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.046530] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.046625] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.046683] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.046824] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.046979] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.046979] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0d620319-8c72-4884-ad6a-0bbd9fb4a432 is going to be updated. [ 1116.071828] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.071963] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.072012] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.072219] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.072353] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.072511] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0d620319-8c72-4884-ad6a-0bbd9fb4a432" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.169191] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fcd5f21-1906-475c-9571-24c419ac05d8 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.169191] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.169191] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.169576] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.169726] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.169846] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.169846] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.170046] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.170179] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.170339] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.170498] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fcd5f21-1906-475c-9571-24c419ac05d8 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.170626] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.170713] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.170918] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.171092] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.171217] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.171492] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.171492] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.171623] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.171666] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.171769] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4fcd5f21-1906-475c-9571-24c419ac05d8',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.202313] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.202538] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.202538] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.202747] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.202856] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.202935] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8778c764-50b3-4305-af4e-70e2f924392d already deleted. [ 1116.202985] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.230199] env[66502]: INFO networking_nsxv3.common.synchronization [req-8d9c38a5-96df-4347-97f8-14f71e3ea698 req-abc6f8f6-9661-40ad-9076-18ac58ae306a tempest-ServerRescueTestJSON-982442935 tempest-ServerRescueTestJSON-982442935-project-member] Enqueued Resource ID: 0880fb6e-a350-4602-9874-47125beb1eb3 with Priority: HIGHEST for action security_group_members [ 1116.231508] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0880fb6e-a350-4602-9874-47125beb1eb3 with Priority: HIGHEST for action security_group_members [ 1116.231971] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0880fb6e-a350-4602-9874-47125beb1eb3 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.232158] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.232266] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.232794] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.232794] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.232930] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.232998] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.233240] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.233417] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.233560] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0880fb6e-a350-4602-9874-47125beb1eb3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.261097] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: SUCCESS [ 1116.261296] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea deletion is rescheduled due to dependency. [ 1116.261411] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.261579] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.261811] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.261999] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.262131] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.262200] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.262347] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.262453] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.262516] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.460165] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.460291] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.460381] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.462536] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.462536] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.462536] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d226a97-2d69-4706-b98b-565700008c6f is going to be updated. [ 1116.500121] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.500434] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.500434] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.500553] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.500743] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.513314] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: IN_PROGRESS for 2s [ 1116.601175] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-332 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.601414] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-332" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.601595] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-332" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.601811] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-332" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.602081] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.602276] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.602399] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.602908] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.602908] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.603170] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1116.603318] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1116.603629] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1116.603629] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1116.603724] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1116.603811] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1116.603959] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1116.623513] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1116.623659] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1116.623740] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1116.623915] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-332" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.624250] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-d06819d8-34ab-4e1a-8d8d-072b53496e4e taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.624419] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-d06819d8-34ab-4e1a-8d8d-072b53496e4e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.624538] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-d06819d8-34ab-4e1a-8d8d-072b53496e4e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.624877] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-d06819d8-34ab-4e1a-8d8d-072b53496e4e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.625019] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d06819d8-34ab-4e1a-8d8d-072b53496e4e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.674155] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4fcd5f21-1906-475c-9571-24c419ac05d8: rpc.has_security_group_logging(os_id): False [ 1116.690694] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.690857] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.690857] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.691097] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.691178] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.691343] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.691474] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.691541] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.691694] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.691769] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.691968] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.692105] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.692179] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.692533] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.692533] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.692533] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.692704] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.692704] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.692827] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.692905] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.692982] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4fcd5f21-1906-475c-9571-24c419ac05d8 is going to be updated. [ 1116.736044] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0880fb6e-a350-4602-9874-47125beb1eb3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.764514] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.766955] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.767242] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.767360] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.767593] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.767766] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.785041] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fcd5f21-1906-475c-9571-24c419ac05d8 in Status: IN_PROGRESS for 2s [ 1116.841696] env[66502]: INFO networking_nsxv3.common.synchronization [None req-de9d8f0b-9f2b-4f52-98a4-b20c3c6bb62a None None] Enqueued Resource ID: 5f580c32-7a98-498a-9cc4-d4cc833cb29c with Priority: HIGHEST for action port [ 1116.842154] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5f580c32-7a98-498a-9cc4-d4cc833cb29c with Priority: HIGHEST for action port [ 1116.842476] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-5f580c32-7a98-498a-9cc4-d4cc833cb29c taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.842610] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5f580c32-7a98-498a-9cc4-d4cc833cb29c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.842681] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5f580c32-7a98-498a-9cc4-d4cc833cb29c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.842942] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5f580c32-7a98-498a-9cc4-d4cc833cb29c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.846508] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5f580c32-7a98-498a-9cc4-d4cc833cb29c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.128075] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.128863] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.129423] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.130068] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.130694] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.131262] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port d06819d8-34ab-4e1a-8d8d-072b53496e4e not found, creating... [ 1117.131874] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.132492] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.133255] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.133523] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.134563] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.134563] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.134563] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.134563] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.136507] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.136507] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.136507] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: d06819d8-34ab-4e1a-8d8d-072b53496e4e is going to be created. [ 1117.156966] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.157232] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.157366] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.158517] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.158806] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.159123] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-d06819d8-34ab-4e1a-8d8d-072b53496e4e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.239514] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0880fb6e-a350-4602-9874-47125beb1eb3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.266651] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.349475] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5f580c32-7a98-498a-9cc4-d4cc833cb29c [ 1117.349814] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.349967] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.349967] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.350257] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.350310] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.350416] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5f580c32-7a98-498a-9cc4-d4cc833cb29c already deleted. [ 1117.350508] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5f580c32-7a98-498a-9cc4-d4cc833cb29c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.747401] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.747570] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.747762] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.748291] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.748291] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.748291] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0880fb6e-a350-4602-9874-47125beb1eb3 is going to be updated. [ 1117.769698] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.769698] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.769698] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.770408] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.770408] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.770408] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea is going to be updated. [ 1117.781141] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.781321] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.781383] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.781575] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.781720] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.791570] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0880fb6e-a350-4602-9874-47125beb1eb3 in Status: IN_PROGRESS for 2s [ 1117.808394] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.808394] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.808394] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.808394] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.808394] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.818014] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: IN_PROGRESS for 2s [ 1117.894841] env[66502]: INFO networking_nsxv3.common.synchronization [req-8d9c38a5-96df-4347-97f8-14f71e3ea698 req-4a240e92-b292-4e64-bd5e-63acbbce1948 service nova] Enqueued Resource ID: 0880fb6e-a350-4602-9874-47125beb1eb3 with Priority: HIGHEST for action security_group_rules [ 1117.895334] env[66502]: INFO networking_nsxv3.common.synchronization [req-8d9c38a5-96df-4347-97f8-14f71e3ea698 req-4a240e92-b292-4e64-bd5e-63acbbce1948 service nova] Enqueued Resource ID: 0880fb6e-a350-4602-9874-47125beb1eb3 with Priority: HIGHEST for action security_group_members [ 1117.897454] env[66502]: INFO networking_nsxv3.common.synchronization [req-8d9c38a5-96df-4347-97f8-14f71e3ea698 req-4a240e92-b292-4e64-bd5e-63acbbce1948 service nova] Enqueued Resource ID: d06819d8-34ab-4e1a-8d8d-072b53496e4e with Priority: HIGHEST for action port [ 1117.897454] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0880fb6e-a350-4602-9874-47125beb1eb3 with Priority: HIGHEST for action security_group_rules [ 1117.897454] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0880fb6e-a350-4602-9874-47125beb1eb3 with Priority: HIGHEST for action security_group_members [ 1117.897454] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d06819d8-34ab-4e1a-8d8d-072b53496e4e with Priority: HIGHEST for action port [ 1117.897454] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0880fb6e-a350-4602-9874-47125beb1eb3 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.897454] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.897454] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.897454] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.897923] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0880fb6e-a350-4602-9874-47125beb1eb3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.900026] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0880fb6e-a350-4602-9874-47125beb1eb3 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.900026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.900026] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-d06819d8-34ab-4e1a-8d8d-072b53496e4e taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.902364] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d06819d8-34ab-4e1a-8d8d-072b53496e4e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.902364] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d06819d8-34ab-4e1a-8d8d-072b53496e4e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.902364] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d06819d8-34ab-4e1a-8d8d-072b53496e4e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.902364] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d06819d8-34ab-4e1a-8d8d-072b53496e4e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.056649] env[66502]: INFO networking_nsxv3.common.synchronization [None req-b7fdbf1b-61e8-4fe4-b40b-a2ce6aba9707 tempest-AttachInterfacesTestJSON-1531294335 tempest-AttachInterfacesTestJSON-1531294335-project-member] Enqueued Resource ID: fabd7a28-e5fa-4d14-9bb3-bfd99d170f07 with Priority: HIGHEST for action security_group_rules [ 1118.058010] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fabd7a28-e5fa-4d14-9bb3-bfd99d170f07 with Priority: HIGHEST for action security_group_rules [ 1118.058487] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fabd7a28-e5fa-4d14-9bb3-bfd99d170f07 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.058666] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fabd7a28-e5fa-4d14-9bb3-bfd99d170f07" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.058733] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fabd7a28-e5fa-4d14-9bb3-bfd99d170f07" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.059155] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fabd7a28-e5fa-4d14-9bb3-bfd99d170f07" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.062962] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fabd7a28-e5fa-4d14-9bb3-bfd99d170f07',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.200813] env[66502]: INFO networking_nsxv3.common.synchronization [None req-eb4723e8-f4d7-4424-a6d6-259e027cfd60 tempest-AttachInterfacesTestJSON-1531294335 tempest-AttachInterfacesTestJSON-1531294335-project-member] Enqueued Resource ID: fabd7a28-e5fa-4d14-9bb3-bfd99d170f07 with Priority: HIGHEST for action security_group_rules [ 1118.201468] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fabd7a28-e5fa-4d14-9bb3-bfd99d170f07 with Priority: HIGHEST for action security_group_rules [ 1118.201786] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fabd7a28-e5fa-4d14-9bb3-bfd99d170f07 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.201931] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fabd7a28-e5fa-4d14-9bb3-bfd99d170f07" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.403257] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0880fb6e-a350-4602-9874-47125beb1eb3 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.403548] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.403584] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d06819d8-34ab-4e1a-8d8d-072b53496e4e with status ACTIVE [ 1118.403758] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.403864] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.403929] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.404457] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.404457] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.404457] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.404669] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.404669] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.404669] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.404757] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.404912] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.405071] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.405071] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.405209] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.405281] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.405361] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d06819d8-34ab-4e1a-8d8d-072b53496e4e is going to be updated. [ 1118.428332] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.428332] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.428332] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.428332] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.428332] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.428332] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d06819d8-34ab-4e1a-8d8d-072b53496e4e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.530672] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: SUCCESS [ 1118.530903] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.531117] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.531360] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.531616] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.531800] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.531892] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.532098] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.532192] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.532323] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.532413] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.589881] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.590266] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.590266] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.590424] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.590521] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.590618] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fabd7a28-e5fa-4d14-9bb3-bfd99d170f07 already deleted. [ 1118.590701] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fabd7a28-e5fa-4d14-9bb3-bfd99d170f07" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.590853] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fabd7a28-e5fa-4d14-9bb3-bfd99d170f07" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.591017] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fabd7a28-e5fa-4d14-9bb3-bfd99d170f07" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.591110] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fabd7a28-e5fa-4d14-9bb3-bfd99d170f07',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.799368] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4fcd5f21-1906-475c-9571-24c419ac05d8 in Status: SUCCESS [ 1118.799827] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.037196] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.037196] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.037196] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.037196] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.037196] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.037196] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.040025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.040025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.040025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.040025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.040025] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.040025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.040025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.040025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.040025] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.040025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.040025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.040025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.040025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.040025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.042216] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.113520] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.113520] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.113520] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.113819] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.113819] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.113878] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fabd7a28-e5fa-4d14-9bb3-bfd99d170f07 already deleted. [ 1119.113961] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fabd7a28-e5fa-4d14-9bb3-bfd99d170f07" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.545568] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9d226a97-2d69-4706-b98b-565700008c6f: rpc.has_security_group_logging(os_id): False [ 1119.578021] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.578206] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.578293] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.578665] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.578665] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.579879] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.579879] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.579879] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.579879] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.579879] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.579879] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.579879] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.579879] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.579879] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.579879] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.580510] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.580510] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.580510] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.580510] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.580510] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.580510] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d226a97-2d69-4706-b98b-565700008c6f is going to be updated. [ 1119.672453] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.672604] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.672645] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.673201] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.673201] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.699288] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: IN_PROGRESS for 2s [ 1119.806027] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0880fb6e-a350-4602-9874-47125beb1eb3 in Status: SUCCESS [ 1119.806027] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.806027] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.806326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.806599] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.806790] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.806885] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.807275] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.807573] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.807573] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0880fb6e-a350-4602-9874-47125beb1eb3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.827309] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: SUCCESS [ 1119.827665] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.828067] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.828219] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.828405] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.828683] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.828683] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.828773] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.828805] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.828882] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.828987] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.310127] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0880fb6e-a350-4602-9874-47125beb1eb3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.332901] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-704e5eab-aa44-4493-8c9a-0b24250e7bea taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.333131] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.333217] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.333443] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.333610] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.333746] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.333838] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.334064] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.334178] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.334279] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.334432] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-704e5eab-aa44-4493-8c9a-0b24250e7bea taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.334513] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.334590] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.334728] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.334863] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.334946] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.335017] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.335143] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.335211] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.335284] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.335365] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.812432] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0880fb6e-a350-4602-9874-47125beb1eb3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.838503] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 704e5eab-aa44-4493-8c9a-0b24250e7bea: rpc.has_security_group_logging(os_id): False [ 1120.857822] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.857966] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.858046] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.858262] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.858354] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.858789] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.858789] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.858789] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.858934] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.858934] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.859304] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.859392] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.859392] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.859556] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.859634] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.859818] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.859911] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.859969] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.860136] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.861032] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.861032] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea is going to be updated. [ 1120.947441] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.947441] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.947615] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.947686] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.947831] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.967061] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: IN_PROGRESS for 2s [ 1121.315879] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.316159] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.316159] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.316457] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.316643] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.316713] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0880fb6e-a350-4602-9874-47125beb1eb3 is going to be updated. [ 1121.355811] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.356045] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.356045] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.357820] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.357820] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.367236] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0880fb6e-a350-4602-9874-47125beb1eb3 in Status: IN_PROGRESS for 2s [ 1121.726293] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: SUCCESS [ 1121.726668] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.347502] env[66502]: INFO networking_nsxv3.common.synchronization [req-0300d5db-6b1c-4806-9af6-cc2cea0689fe req-3e80e1bd-58ba-40a4-a1c0-50615052cb61 tempest-ServerDiskConfigTestJSON-940033598 tempest-ServerDiskConfigTestJSON-940033598-project-member] Enqueued Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGHEST for action security_group_members [ 1122.352027] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGHEST for action security_group_members [ 1122.352027] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-aba51398-48dc-4f5e-b3cf-1da4130d58fb taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.352027] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.352027] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.352027] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.352027] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.352027] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.352027] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.352027] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.352027] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.352027] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.518233] env[66502]: INFO networking_nsxv3.common.synchronization [None req-71fe2a81-40af-4a01-8611-eb4e135cd23e None None] Enqueued Resource ID: 3efb5efe-6342-4947-8432-b51d43a726f8 with Priority: HIGHEST for action port [ 1122.519301] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3efb5efe-6342-4947-8432-b51d43a726f8 with Priority: HIGHEST for action port [ 1122.520144] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-3efb5efe-6342-4947-8432-b51d43a726f8 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.520323] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3efb5efe-6342-4947-8432-b51d43a726f8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.520388] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3efb5efe-6342-4947-8432-b51d43a726f8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.520669] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3efb5efe-6342-4947-8432-b51d43a726f8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.520757] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3efb5efe-6342-4947-8432-b51d43a726f8',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.852965] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.853619] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.853619] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.853783] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.853852] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.854053] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.854164] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.854229] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.854426] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.854516] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.854609] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb is going to be updated. [ 1122.881946] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.882138] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.882677] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.882944] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.883256] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.894409] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb in Status: IN_PROGRESS for 2s [ 1122.984560] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: SUCCESS [ 1122.984560] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.025301] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3efb5efe-6342-4947-8432-b51d43a726f8 [ 1123.025543] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.025677] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.025738] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.025961] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.026075] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.026195] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3efb5efe-6342-4947-8432-b51d43a726f8 already deleted. [ 1123.026252] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3efb5efe-6342-4947-8432-b51d43a726f8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.032039] env[66502]: INFO networking_nsxv3.common.synchronization [req-af42b94b-b178-4619-aa63-14cfa40cdb3c req-491373fa-602f-4425-b2e3-b481cb9bb895 tempest-ServerActionsTestOtherA-1204678764 tempest-ServerActionsTestOtherA-1204678764-project-member] Enqueued Resource ID: 8778c764-50b3-4305-af4e-70e2f924392d with Priority: HIGHEST for action security_group_members [ 1123.032765] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8778c764-50b3-4305-af4e-70e2f924392d with Priority: HIGHEST for action security_group_members [ 1123.033022] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-8778c764-50b3-4305-af4e-70e2f924392d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.033590] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.033673] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.033923] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.034105] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.034301] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.034301] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.034501] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.034501] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.034703] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8778c764-50b3-4305-af4e-70e2f924392d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.381101] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0880fb6e-a350-4602-9874-47125beb1eb3 in Status: SUCCESS [ 1123.381400] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.382087] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.382087] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.382087] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.382774] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.382774] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.382774] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.382774] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.382774] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.382774] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0880fb6e-a350-4602-9874-47125beb1eb3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.516216] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-170 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.516406] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-170" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.516976] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-170" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.516976] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-170" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.517512] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.518106] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.518106] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.519252] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.519252] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.519252] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1123.519252] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1123.520177] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1123.520177] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1123.520177] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1123.520386] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1123.520441] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1123.538611] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.538611] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.538611] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.538611] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.538611] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.538935] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.538935] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.538935] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.539097] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.539206] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.539342] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8778c764-50b3-4305-af4e-70e2f924392d already deleted. [ 1123.539432] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.540692] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1123.540923] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1123.541120] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1123.541334] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-170" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.541842] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-957e97a1-d95f-4f56-8023-7b6ac854d55e taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.542079] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-957e97a1-d95f-4f56-8023-7b6ac854d55e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.542253] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-957e97a1-d95f-4f56-8023-7b6ac854d55e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.542594] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-957e97a1-d95f-4f56-8023-7b6ac854d55e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.542904] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('957e97a1-d95f-4f56-8023-7b6ac854d55e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1123.888292] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0880fb6e-a350-4602-9874-47125beb1eb3 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.888292] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.888402] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.888639] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.888803] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.889048] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.889048] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.889144] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.889354] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.889354] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.889523] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0880fb6e-a350-4602-9874-47125beb1eb3 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.889611] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.889670] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.889817] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.889949] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1123.890049] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1123.890142] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1123.890268] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1123.890376] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.890461] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1123.890549] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0880fb6e-a350-4602-9874-47125beb1eb3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.046812] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.047351] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.047530] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.047945] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.048261] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.048542] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 957e97a1-d95f-4f56-8023-7b6ac854d55e not found, creating... [ 1124.049359] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.049571] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.050439] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.050944] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.051387] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.052367] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.052497] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.052647] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.053144] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.053532] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.053727] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 957e97a1-d95f-4f56-8023-7b6ac854d55e is going to be created. [ 1124.081462] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.081956] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.082210] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.082413] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.082716] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.083213] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-957e97a1-d95f-4f56-8023-7b6ac854d55e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.396069] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0880fb6e-a350-4602-9874-47125beb1eb3: rpc.has_security_group_logging(os_id): False [ 1124.418245] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.418486] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.418486] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.418665] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.418783] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.418970] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.419087] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.419145] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.419356] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.419435] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.419612] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.419704] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.419763] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.419900] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.419972] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.420534] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.420827] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.420908] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.421019] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.421079] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.421165] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0880fb6e-a350-4602-9874-47125beb1eb3 is going to be updated. [ 1124.514685] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.514843] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.515056] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.515818] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.515818] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.539931] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0880fb6e-a350-4602-9874-47125beb1eb3 in Status: IN_PROGRESS for 2s [ 1124.846211] env[66502]: INFO networking_nsxv3.common.synchronization [req-af42b94b-b178-4619-aa63-14cfa40cdb3c req-8e21e948-9233-4cc0-a792-192015caef80 service nova] Enqueued Resource ID: 8778c764-50b3-4305-af4e-70e2f924392d with Priority: HIGHEST for action security_group_rules [ 1124.846401] env[66502]: INFO networking_nsxv3.common.synchronization [req-af42b94b-b178-4619-aa63-14cfa40cdb3c req-8e21e948-9233-4cc0-a792-192015caef80 service nova] Enqueued Resource ID: 8778c764-50b3-4305-af4e-70e2f924392d with Priority: HIGHEST for action security_group_members [ 1124.846551] env[66502]: INFO networking_nsxv3.common.synchronization [req-af42b94b-b178-4619-aa63-14cfa40cdb3c req-8e21e948-9233-4cc0-a792-192015caef80 service nova] Enqueued Resource ID: 957e97a1-d95f-4f56-8023-7b6ac854d55e with Priority: HIGHEST for action port [ 1124.847779] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8778c764-50b3-4305-af4e-70e2f924392d with Priority: HIGHEST for action security_group_rules [ 1124.847944] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8778c764-50b3-4305-af4e-70e2f924392d with Priority: HIGHEST for action security_group_members [ 1124.848050] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 957e97a1-d95f-4f56-8023-7b6ac854d55e with Priority: HIGHEST for action port [ 1124.849305] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8778c764-50b3-4305-af4e-70e2f924392d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.849305] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.849305] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.849305] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.849305] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8778c764-50b3-4305-af4e-70e2f924392d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.850976] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-8778c764-50b3-4305-af4e-70e2f924392d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.850976] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.850976] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.855122] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.855122] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.855122] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.855122] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.855122] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.855122] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1124.855122] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8778c764-50b3-4305-af4e-70e2f924392d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.855400] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-957e97a1-d95f-4f56-8023-7b6ac854d55e taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1124.855484] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-957e97a1-d95f-4f56-8023-7b6ac854d55e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1124.855548] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-957e97a1-d95f-4f56-8023-7b6ac854d55e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1124.855709] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-957e97a1-d95f-4f56-8023-7b6ac854d55e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1124.855784] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('957e97a1-d95f-4f56-8023-7b6ac854d55e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1124.906965] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb in Status: SUCCESS [ 1124.907403] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb deletion is rescheduled due to dependency. [ 1124.907669] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.359314] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8778c764-50b3-4305-af4e-70e2f924392d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.359785] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-8778c764-50b3-4305-af4e-70e2f924392d taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.359785] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.360139] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 957e97a1-d95f-4f56-8023-7b6ac854d55e with status ACTIVE [ 1125.360449] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.360555] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.360591] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.360979] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.360979] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.361146] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.361146] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.361259] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.361748] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.361748] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.361748] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.361748] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.361748] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.361748] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.361748] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.362846] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 957e97a1-d95f-4f56-8023-7b6ac854d55e is going to be updated. [ 1125.389566] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.389703] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.389772] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.389985] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.390354] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.390354] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-957e97a1-d95f-4f56-8023-7b6ac854d55e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.424418] env[66502]: INFO networking_nsxv3.common.synchronization [None req-4206ff51-0fe0-47aa-b870-7f1c35ad8db0 None None] Enqueued Resource ID: 42dd5917-7cd1-46be-86cf-3e6eaea60ec0 with Priority: HIGHEST for action port [ 1125.424967] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 42dd5917-7cd1-46be-86cf-3e6eaea60ec0 with Priority: HIGHEST for action port [ 1125.425273] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-42dd5917-7cd1-46be-86cf-3e6eaea60ec0 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.425384] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-42dd5917-7cd1-46be-86cf-3e6eaea60ec0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.425447] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-42dd5917-7cd1-46be-86cf-3e6eaea60ec0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.425692] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-42dd5917-7cd1-46be-86cf-3e6eaea60ec0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.425770] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('42dd5917-7cd1-46be-86cf-3e6eaea60ec0',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.528525] env[66502]: INFO networking_nsxv3.common.synchronization [req-5fc3c182-14d6-4296-af45-a8ef3a691c8c req-210af358-ecf1-4d4f-be76-1a47773afde3 tempest-AttachInterfacesTestJSON-1531294335 tempest-AttachInterfacesTestJSON-1531294335-project-member] Enqueued Resource ID: fabd7a28-e5fa-4d14-9bb3-bfd99d170f07 with Priority: HIGHEST for action security_group_members [ 1125.529838] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fabd7a28-e5fa-4d14-9bb3-bfd99d170f07 with Priority: HIGHEST for action security_group_members [ 1125.529838] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-fabd7a28-e5fa-4d14-9bb3-bfd99d170f07 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.529838] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fabd7a28-e5fa-4d14-9bb3-bfd99d170f07" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.529838] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fabd7a28-e5fa-4d14-9bb3-bfd99d170f07" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.530144] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fabd7a28-e5fa-4d14-9bb3-bfd99d170f07" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.530334] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.530457] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.530519] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.530685] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.530869] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.530914] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fabd7a28-e5fa-4d14-9bb3-bfd99d170f07',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.861062] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8778c764-50b3-4305-af4e-70e2f924392d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.887286] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-584 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.887789] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-584" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.888095] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-584" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.888752] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-584" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.888752] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.889145] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.889145] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.890038] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.890038] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.890038] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1125.890038] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1125.890038] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1125.890038] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1125.890630] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1125.891442] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1125.891442] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1125.916619] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1125.916833] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1125.916903] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1125.917368] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-584" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.917512] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-7f414c4f-f79f-4255-97bb-117bcd5a8ab3 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.917699] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-7f414c4f-f79f-4255-97bb-117bcd5a8ab3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.917819] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-7f414c4f-f79f-4255-97bb-117bcd5a8ab3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.918989] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-7f414c4f-f79f-4255-97bb-117bcd5a8ab3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.919181] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f414c4f-f79f-4255-97bb-117bcd5a8ab3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1125.929998] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 42dd5917-7cd1-46be-86cf-3e6eaea60ec0 [ 1125.930276] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1125.930411] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1125.930501] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1125.930703] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1125.930796] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1125.930888] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:42dd5917-7cd1-46be-86cf-3e6eaea60ec0 already deleted. [ 1125.930960] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-42dd5917-7cd1-46be-86cf-3e6eaea60ec0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.035108] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.035108] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.035108] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.035108] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.035108] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.035108] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.035108] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.035108] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.035108] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.035108] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.035108] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fabd7a28-e5fa-4d14-9bb3-bfd99d170f07 already deleted. [ 1126.035108] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fabd7a28-e5fa-4d14-9bb3-bfd99d170f07" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.363969] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.364173] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.364213] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.364412] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.364504] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.364606] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8778c764-50b3-4305-af4e-70e2f924392d is going to be created. [ 1126.391782] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.391882] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.391882] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.392127] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.392287] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.403025] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8778c764-50b3-4305-af4e-70e2f924392d in Status: UNINITIALIZED for 2s [ 1126.422541] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.422753] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.422874] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.423185] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.423336] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.423535] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port 7f414c4f-f79f-4255-97bb-117bcd5a8ab3 not found, creating... [ 1126.423829] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.423990] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.424121] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.424368] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.424464] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.425614] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.425614] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.425614] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.425614] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.425614] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.425614] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: 7f414c4f-f79f-4255-97bb-117bcd5a8ab3 is going to be created. [ 1126.448821] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.449127] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.449191] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.449576] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.449842] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.450094] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-7f414c4f-f79f-4255-97bb-117bcd5a8ab3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.529041] env[66502]: INFO networking_nsxv3.common.synchronization [req-86a4164f-3309-48db-ab37-228b996f628e req-de70d7ef-4389-47a3-912a-f4c9adebf7ed tempest-ServersTestJSON-1210226259 tempest-ServersTestJSON-1210226259-project-member] Enqueued Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_members [ 1126.529750] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_members [ 1126.530286] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.530433] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.530533] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.530803] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.531688] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.532568] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.532568] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.532568] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.532568] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.532568] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1126.564558] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0880fb6e-a350-4602-9874-47125beb1eb3 in Status: SUCCESS [ 1126.564771] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.036193] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.220159] env[66502]: INFO networking_nsxv3.common.synchronization [req-5fc3c182-14d6-4296-af45-a8ef3a691c8c req-eafcd341-01c9-4de8-84c3-96457c304647 service nova] Enqueued Resource ID: fabd7a28-e5fa-4d14-9bb3-bfd99d170f07 with Priority: HIGHEST for action security_group_rules [ 1127.220159] env[66502]: INFO networking_nsxv3.common.synchronization [req-5fc3c182-14d6-4296-af45-a8ef3a691c8c req-eafcd341-01c9-4de8-84c3-96457c304647 service nova] Enqueued Resource ID: fabd7a28-e5fa-4d14-9bb3-bfd99d170f07 with Priority: HIGHEST for action security_group_members [ 1127.220240] env[66502]: INFO networking_nsxv3.common.synchronization [req-5fc3c182-14d6-4296-af45-a8ef3a691c8c req-eafcd341-01c9-4de8-84c3-96457c304647 service nova] Enqueued Resource ID: 7f414c4f-f79f-4255-97bb-117bcd5a8ab3 with Priority: HIGHEST for action port [ 1127.220826] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fabd7a28-e5fa-4d14-9bb3-bfd99d170f07 with Priority: HIGHEST for action security_group_rules [ 1127.221771] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fabd7a28-e5fa-4d14-9bb3-bfd99d170f07 with Priority: HIGHEST for action security_group_members [ 1127.221906] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7f414c4f-f79f-4255-97bb-117bcd5a8ab3 with Priority: HIGHEST for action port [ 1127.222260] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fabd7a28-e5fa-4d14-9bb3-bfd99d170f07 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.222442] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fabd7a28-e5fa-4d14-9bb3-bfd99d170f07" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.222515] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fabd7a28-e5fa-4d14-9bb3-bfd99d170f07" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.222720] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fabd7a28-e5fa-4d14-9bb3-bfd99d170f07" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.223032] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fabd7a28-e5fa-4d14-9bb3-bfd99d170f07',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.224237] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-fabd7a28-e5fa-4d14-9bb3-bfd99d170f07 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.224397] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fabd7a28-e5fa-4d14-9bb3-bfd99d170f07" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.224469] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fabd7a28-e5fa-4d14-9bb3-bfd99d170f07" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.225267] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fabd7a28-e5fa-4d14-9bb3-bfd99d170f07" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.229194] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.229609] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.229609] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.229785] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.229785] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.229903] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fabd7a28-e5fa-4d14-9bb3-bfd99d170f07',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.231456] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-7f414c4f-f79f-4255-97bb-117bcd5a8ab3 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.231456] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7f414c4f-f79f-4255-97bb-117bcd5a8ab3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.233081] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7f414c4f-f79f-4255-97bb-117bcd5a8ab3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.233081] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7f414c4f-f79f-4255-97bb-117bcd5a8ab3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.233081] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7f414c4f-f79f-4255-97bb-117bcd5a8ab3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.538518] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.734651] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7f414c4f-f79f-4255-97bb-117bcd5a8ab3 with status ACTIVE [ 1127.736077] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.736077] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.736077] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.736077] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.736077] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.736077] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.736077] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.736077] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.736077] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.736077] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.736659] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.736659] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.736659] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.736659] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.736659] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.736659] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7f414c4f-f79f-4255-97bb-117bcd5a8ab3 is going to be updated. [ 1127.741028] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fabd7a28-e5fa-4d14-9bb3-bfd99d170f07',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.741028] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-fabd7a28-e5fa-4d14-9bb3-bfd99d170f07 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.741028] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fabd7a28-e5fa-4d14-9bb3-bfd99d170f07" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.767898] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.767898] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.767898] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.767898] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.768226] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.768284] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7f414c4f-f79f-4255-97bb-117bcd5a8ab3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.041882] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.042200] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.042200] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.042392] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.042487] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.042591] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d226a97-2d69-4706-b98b-565700008c6f is going to be updated. [ 1128.077030] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.077343] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.077528] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.077853] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.078114] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.090165] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: IN_PROGRESS for 2s [ 1128.240608] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fabd7a28-e5fa-4d14-9bb3-bfd99d170f07',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.415422] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8778c764-50b3-4305-af4e-70e2f924392d in Status: SUCCESS [ 1128.415643] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.415808] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.416055] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.416298] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.416421] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.416490] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.416669] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.416768] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.416857] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.416972] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8778c764-50b3-4305-af4e-70e2f924392d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.743966] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.744314] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.744314] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.744449] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.744479] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.744594] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fabd7a28-e5fa-4d14-9bb3-bfd99d170f07 is going to be created. [ 1128.770140] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.770140] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.770140] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.770410] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.770553] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.780953] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fabd7a28-e5fa-4d14-9bb3-bfd99d170f07 in Status: UNINITIALIZED for 2s [ 1128.920113] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8778c764-50b3-4305-af4e-70e2f924392d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.423053] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8778c764-50b3-4305-af4e-70e2f924392d: rpc.has_security_group_logging(os_id): False [ 1129.441872] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.442085] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.442161] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.442421] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.442530] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.442804] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.442918] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.442976] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.443150] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.443228] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.443317] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8778c764-50b3-4305-af4e-70e2f924392d is going to be created. [ 1129.521883] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.522136] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.522136] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.522440] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.522545] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.534243] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8778c764-50b3-4305-af4e-70e2f924392d in Status: IN_PROGRESS for 2s [ 1129.904015] env[66502]: INFO networking_nsxv3.common.synchronization [req-b5d125e7-5835-4b98-b826-96a1e64362bd req-1abee6ec-799b-4c7f-a751-b547731d9837 tempest-ServerMetadataNegativeTestJSON-1252537876 tempest-ServerMetadataNegativeTestJSON-1252537876-project-member] Enqueued Resource ID: b069d377-c59c-4f56-8831-a284c29b3f31 with Priority: HIGHEST for action security_group_members [ 1129.904575] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b069d377-c59c-4f56-8831-a284c29b3f31 with Priority: HIGHEST for action security_group_members [ 1129.904886] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b069d377-c59c-4f56-8831-a284c29b3f31 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.905030] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b069d377-c59c-4f56-8831-a284c29b3f31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.905094] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b069d377-c59c-4f56-8831-a284c29b3f31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.905366] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b069d377-c59c-4f56-8831-a284c29b3f31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.905519] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.905610] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.905666] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.905865] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.905944] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.905995] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b069d377-c59c-4f56-8831-a284c29b3f31',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.103560] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: SUCCESS [ 1130.103560] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.314382] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-900 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.314624] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-900" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.314750] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-900" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.315117] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-900" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.315395] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.315556] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.315669] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.315885] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.316042] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.316258] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1130.316364] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1130.316469] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1130.316571] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1130.316673] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1130.316771] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1130.316896] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1130.339944] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1130.340162] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1130.340353] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1130.340579] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-900" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.340945] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-bd9baf5f-53fc-498b-ab27-269b16056f0c taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.341174] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-bd9baf5f-53fc-498b-ab27-269b16056f0c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.341307] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-bd9baf5f-53fc-498b-ab27-269b16056f0c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.341663] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-bd9baf5f-53fc-498b-ab27-269b16056f0c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.341811] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd9baf5f-53fc-498b-ab27-269b16056f0c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.407557] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.407749] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.407821] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.408109] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.408216] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.408427] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.408533] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.408596] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.408744] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.408811] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.408908] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b069d377-c59c-4f56-8831-a284c29b3f31 already deleted. [ 1130.408972] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b069d377-c59c-4f56-8831-a284c29b3f31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.793569] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fabd7a28-e5fa-4d14-9bb3-bfd99d170f07 in Status: SUCCESS [ 1130.793791] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fabd7a28-e5fa-4d14-9bb3-bfd99d170f07" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.793963] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fabd7a28-e5fa-4d14-9bb3-bfd99d170f07" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.794205] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fabd7a28-e5fa-4d14-9bb3-bfd99d170f07" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.794400] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.794624] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.794691] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.794850] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.794930] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.795023] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fabd7a28-e5fa-4d14-9bb3-bfd99d170f07" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.795147] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fabd7a28-e5fa-4d14-9bb3-bfd99d170f07',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.843941] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.844171] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.844301] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.844677] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.844850] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.845016] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port bd9baf5f-53fc-498b-ab27-269b16056f0c not found, creating... [ 1130.845283] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.845445] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.845619] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.845855] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.845995] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.846342] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.846506] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.846622] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.846864] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.847071] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.847289] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: bd9baf5f-53fc-498b-ab27-269b16056f0c is going to be created. [ 1130.869319] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.869795] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.870265] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.870371] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.870684] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.870953] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-bd9baf5f-53fc-498b-ab27-269b16056f0c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.297671] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fabd7a28-e5fa-4d14-9bb3-bfd99d170f07',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.548723] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8778c764-50b3-4305-af4e-70e2f924392d in Status: SUCCESS [ 1131.549076] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.581854] env[66502]: INFO networking_nsxv3.common.synchronization [req-b5d125e7-5835-4b98-b826-96a1e64362bd req-4734ab99-f9db-4485-af0d-990e7289f157 service nova] Enqueued Resource ID: b069d377-c59c-4f56-8831-a284c29b3f31 with Priority: HIGHEST for action security_group_rules [ 1131.582097] env[66502]: INFO networking_nsxv3.common.synchronization [req-b5d125e7-5835-4b98-b826-96a1e64362bd req-4734ab99-f9db-4485-af0d-990e7289f157 service nova] Enqueued Resource ID: b069d377-c59c-4f56-8831-a284c29b3f31 with Priority: HIGHEST for action security_group_members [ 1131.582215] env[66502]: INFO networking_nsxv3.common.synchronization [req-b5d125e7-5835-4b98-b826-96a1e64362bd req-4734ab99-f9db-4485-af0d-990e7289f157 service nova] Enqueued Resource ID: bd9baf5f-53fc-498b-ab27-269b16056f0c with Priority: HIGHEST for action port [ 1131.582791] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b069d377-c59c-4f56-8831-a284c29b3f31 with Priority: HIGHEST for action security_group_rules [ 1131.582923] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b069d377-c59c-4f56-8831-a284c29b3f31 with Priority: HIGHEST for action security_group_members [ 1131.583050] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bd9baf5f-53fc-498b-ab27-269b16056f0c with Priority: HIGHEST for action port [ 1131.583434] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b069d377-c59c-4f56-8831-a284c29b3f31 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.583614] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b069d377-c59c-4f56-8831-a284c29b3f31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.583684] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b069d377-c59c-4f56-8831-a284c29b3f31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.583909] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b069d377-c59c-4f56-8831-a284c29b3f31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.583985] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b069d377-c59c-4f56-8831-a284c29b3f31',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.585565] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b069d377-c59c-4f56-8831-a284c29b3f31 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.587610] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b069d377-c59c-4f56-8831-a284c29b3f31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.587610] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b069d377-c59c-4f56-8831-a284c29b3f31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.587610] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b069d377-c59c-4f56-8831-a284c29b3f31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.587610] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.587610] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.587610] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.587610] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.587610] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.587610] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b069d377-c59c-4f56-8831-a284c29b3f31',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.589802] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-bd9baf5f-53fc-498b-ab27-269b16056f0c taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.590131] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bd9baf5f-53fc-498b-ab27-269b16056f0c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.590131] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bd9baf5f-53fc-498b-ab27-269b16056f0c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.590283] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bd9baf5f-53fc-498b-ab27-269b16056f0c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.591686] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bd9baf5f-53fc-498b-ab27-269b16056f0c',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.800886] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fabd7a28-e5fa-4d14-9bb3-bfd99d170f07: rpc.has_security_group_logging(os_id): False [ 1131.824146] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.824412] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.824549] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.824967] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.825171] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.826110] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.826297] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.826387] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.826824] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.826981] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.827176] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fabd7a28-e5fa-4d14-9bb3-bfd99d170f07 is going to be created. [ 1131.906310] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.906820] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.906903] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.907150] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.907443] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.922817] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fabd7a28-e5fa-4d14-9bb3-bfd99d170f07 in Status: IN_PROGRESS for 2s [ 1132.092680] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b069d377-c59c-4f56-8831-a284c29b3f31 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.092971] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b069d377-c59c-4f56-8831-a284c29b3f31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.093375] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b069d377-c59c-4f56-8831-a284c29b3f31',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.094424] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bd9baf5f-53fc-498b-ab27-269b16056f0c with status ACTIVE [ 1132.094681] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.094826] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.094944] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.095228] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.095531] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.095614] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.095752] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.095834] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.096093] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.096189] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.096589] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.096741] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.096805] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.096977] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.097070] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.097185] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bd9baf5f-53fc-498b-ab27-269b16056f0c is going to be updated. [ 1132.121565] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.121716] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.121788] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.122012] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.122155] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.122342] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bd9baf5f-53fc-498b-ab27-269b16056f0c" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.600568] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b069d377-c59c-4f56-8831-a284c29b3f31',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.763283] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-458 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.763471] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-458" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.763697] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-458" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.766969] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-458" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.766969] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.766969] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.766969] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.766969] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.766969] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.766969] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1132.766969] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1132.766969] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1132.766969] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1132.766969] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1132.766969] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1132.766969] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1132.787250] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1132.787463] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1132.787599] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1132.787776] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-458" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.788100] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-c21594ab-8c19-475a-9f56-a209a9319121 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.788287] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-c21594ab-8c19-475a-9f56-a209a9319121" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.788407] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-c21594ab-8c19-475a-9f56-a209a9319121" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.788697] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-c21594ab-8c19-475a-9f56-a209a9319121" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.788905] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c21594ab-8c19-475a-9f56-a209a9319121',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1133.102921] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.103154] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.103244] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.103572] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.103708] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.103840] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b069d377-c59c-4f56-8831-a284c29b3f31 is going to be created. [ 1133.129847] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.129992] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.130202] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.130281] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.130475] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.143664] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b069d377-c59c-4f56-8831-a284c29b3f31 in Status: UNINITIALIZED for 2s [ 1133.291146] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.291429] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.291571] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.291857] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.292017] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.292316] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.292472] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.292587] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.292807] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.292942] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.293268] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.293432] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.293566] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.293846] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.293917] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.294145] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: c21594ab-8c19-475a-9f56-a209a9319121 is going to be updated. [ 1133.324967] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1133.325220] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1133.325307] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1133.325597] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1133.325789] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.326025] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-c21594ab-8c19-475a-9f56-a209a9319121" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1133.938757] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fabd7a28-e5fa-4d14-9bb3-bfd99d170f07 in Status: SUCCESS [ 1133.939134] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fabd7a28-e5fa-4d14-9bb3-bfd99d170f07" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.041911] env[66502]: INFO networking_nsxv3.common.synchronization [req-78916db4-2696-474a-9823-de705df4d645 req-02006abd-65f2-41de-87b5-14a1049c531a service nova] Enqueued Resource ID: 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 with Priority: HIGHEST for action security_group_rules [ 1134.042127] env[66502]: INFO networking_nsxv3.common.synchronization [req-78916db4-2696-474a-9823-de705df4d645 req-02006abd-65f2-41de-87b5-14a1049c531a service nova] Enqueued Resource ID: 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 with Priority: HIGHEST for action security_group_members [ 1134.042258] env[66502]: INFO networking_nsxv3.common.synchronization [req-78916db4-2696-474a-9823-de705df4d645 req-02006abd-65f2-41de-87b5-14a1049c531a service nova] Enqueued Resource ID: c21594ab-8c19-475a-9f56-a209a9319121 with Priority: HIGHEST for action port [ 1134.042800] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 with Priority: HIGHEST for action security_group_rules [ 1134.042929] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 with Priority: HIGHEST for action security_group_members [ 1134.043365] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c21594ab-8c19-475a-9f56-a209a9319121 with Priority: HIGHEST for action port [ 1134.043787] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.043979] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.044108] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.044578] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.044578] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14691ab9-6ef7-4499-a5c8-0c1a0b5a8191',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.045443] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.046122] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.046122] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.046122] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.046122] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.046122] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.046886] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.046886] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.046886] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.047302] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14691ab9-6ef7-4499-a5c8-0c1a0b5a8191',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.048933] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-c21594ab-8c19-475a-9f56-a209a9319121 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.049598] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c21594ab-8c19-475a-9f56-a209a9319121" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.049598] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c21594ab-8c19-475a-9f56-a209a9319121" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.050337] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c21594ab-8c19-475a-9f56-a209a9319121" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.050337] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c21594ab-8c19-475a-9f56-a209a9319121',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.550510] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('14691ab9-6ef7-4499-a5c8-0c1a0b5a8191',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.555128] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.555128] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.555128] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c21594ab-8c19-475a-9f56-a209a9319121 with status ACTIVE [ 1134.555128] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.555128] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.555128] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.555128] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.555128] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.555128] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.555128] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.555128] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.555128] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.555128] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.555128] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.556271] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.556271] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.556271] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.556271] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.556271] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c21594ab-8c19-475a-9f56-a209a9319121 is going to be updated. [ 1134.589528] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.589740] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.589799] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.590026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.590173] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.590340] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c21594ab-8c19-475a-9f56-a209a9319121" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.054138] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('14691ab9-6ef7-4499-a5c8-0c1a0b5a8191',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.158233] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b069d377-c59c-4f56-8831-a284c29b3f31 in Status: SUCCESS [ 1135.158233] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b069d377-c59c-4f56-8831-a284c29b3f31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.158233] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b069d377-c59c-4f56-8831-a284c29b3f31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.158233] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b069d377-c59c-4f56-8831-a284c29b3f31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.158233] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.158233] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.158233] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.158894] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.159326] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.159662] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b069d377-c59c-4f56-8831-a284c29b3f31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.159941] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b069d377-c59c-4f56-8831-a284c29b3f31',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.556000] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.556183] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.556265] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.556503] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.556597] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.556699] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 is going to be updated. [ 1135.588717] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.588717] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.588717] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.588717] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.589239] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.600254] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 in Status: IN_PROGRESS for 2s [ 1135.663292] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b069d377-c59c-4f56-8831-a284c29b3f31 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.666133] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b069d377-c59c-4f56-8831-a284c29b3f31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.666133] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b069d377-c59c-4f56-8831-a284c29b3f31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.666133] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b069d377-c59c-4f56-8831-a284c29b3f31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.666133] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.666133] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.666133] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.666133] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.666133] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.666133] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b069d377-c59c-4f56-8831-a284c29b3f31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.666133] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b069d377-c59c-4f56-8831-a284c29b3f31 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.666133] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b069d377-c59c-4f56-8831-a284c29b3f31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.666133] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b069d377-c59c-4f56-8831-a284c29b3f31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.666133] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b069d377-c59c-4f56-8831-a284c29b3f31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.666133] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.666133] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.666133] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.666133] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.666133] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.667278] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b069d377-c59c-4f56-8831-a284c29b3f31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.667278] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b069d377-c59c-4f56-8831-a284c29b3f31',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1136.171022] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b069d377-c59c-4f56-8831-a284c29b3f31: rpc.has_security_group_logging(os_id): False [ 1136.198713] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.199012] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.199148] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.199540] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.199698] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.200071] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.200279] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.200389] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.200662] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.200817] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.201251] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.201395] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.201585] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.201833] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.202036] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.202320] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.202523] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.202624] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.202872] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.202979] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.203116] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b069d377-c59c-4f56-8831-a284c29b3f31 is going to be created. [ 1136.310154] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.310415] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.310537] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.310978] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.311075] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.325039] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b069d377-c59c-4f56-8831-a284c29b3f31 in Status: IN_PROGRESS for 2s [ 1136.507832] env[66502]: INFO networking_nsxv3.common.synchronization [req-86f26c65-621c-470d-8569-ee3ba00153fe req-fc1b3718-9c9b-4537-80eb-0e5fcd9a7cf4 tempest-ServerRescueNegativeTestJSON-1777100369 tempest-ServerRescueNegativeTestJSON-1777100369-project-member] Enqueued Resource ID: 6768b7ab-f09a-42ec-87a9-9546009ee043 with Priority: HIGHEST for action security_group_members [ 1136.508558] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6768b7ab-f09a-42ec-87a9-9546009ee043 with Priority: HIGHEST for action security_group_members [ 1136.508939] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-6768b7ab-f09a-42ec-87a9-9546009ee043 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.509201] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6768b7ab-f09a-42ec-87a9-9546009ee043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.509343] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6768b7ab-f09a-42ec-87a9-9546009ee043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.509737] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6768b7ab-f09a-42ec-87a9-9546009ee043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.509981] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1136.510154] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1136.510278] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1136.510571] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1136.510708] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1136.510853] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6768b7ab-f09a-42ec-87a9-9546009ee043',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.013012] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.013196] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.013254] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.013465] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.013559] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.013777] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.013878] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.013942] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.014112] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.014190] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.014276] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6768b7ab-f09a-42ec-87a9-9546009ee043 is going to be updated. [ 1137.043186] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.043348] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.043389] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.043613] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.043756] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.064296] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6768b7ab-f09a-42ec-87a9-9546009ee043 in Status: IN_PROGRESS for 2s [ 1137.610666] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 in Status: SUCCESS [ 1137.610911] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.611098] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.611412] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.611700] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.612312] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.612312] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.612312] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.612312] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.612312] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.612615] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('14691ab9-6ef7-4499-a5c8-0c1a0b5a8191',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.114803] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('14691ab9-6ef7-4499-a5c8-0c1a0b5a8191',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.338710] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b069d377-c59c-4f56-8831-a284c29b3f31 in Status: SUCCESS [ 1138.338989] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b069d377-c59c-4f56-8831-a284c29b3f31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.618823] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191: rpc.has_security_group_logging(os_id): False [ 1138.642614] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.642863] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.642863] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.643392] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.643392] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.643567] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.643567] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.643704] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.643809] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.643884] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.643973] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 is going to be updated. [ 1138.729030] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.729030] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.729235] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.729272] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.729414] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.746601] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 in Status: IN_PROGRESS for 2s [ 1139.075519] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6768b7ab-f09a-42ec-87a9-9546009ee043 in Status: SUCCESS [ 1139.075692] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6768b7ab-f09a-42ec-87a9-9546009ee043 deletion is rescheduled due to dependency. [ 1139.075827] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6768b7ab-f09a-42ec-87a9-9546009ee043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1140.763492] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 in Status: SUCCESS [ 1140.763974] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.509455] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1141.509728] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1143.363749] env[66502]: INFO networking_nsxv3.common.synchronization [req-208fcd6c-f02e-407d-85e5-d362ddd9e3cc req-716432ec-e17e-4c2c-9bef-a766c67c1ab6 tempest-ServersTestJSON-1210226259 tempest-ServersTestJSON-1210226259-project-member] Enqueued Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_members [ 1143.364879] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_members [ 1143.365631] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.365631] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.365631] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.365798] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.365967] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.366082] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.366143] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.366325] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.366393] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.367031] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.716219] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-708 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.716219] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-708" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.716219] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-708" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.716434] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-708" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.716849] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.717267] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.717598] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.718024] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.719049] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.719049] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1143.719049] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1143.719049] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1143.719049] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1143.719049] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1143.719404] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1143.719404] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1143.744663] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1143.744663] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1143.744663] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1143.744663] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-708" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.744663] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-9b2ae488-cbe1-49c5-8a9e-7ba1dba96f05 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.744663] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-9b2ae488-cbe1-49c5-8a9e-7ba1dba96f05" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.744663] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-9b2ae488-cbe1-49c5-8a9e-7ba1dba96f05" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.745570] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-9b2ae488-cbe1-49c5-8a9e-7ba1dba96f05" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.745570] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b2ae488-cbe1-49c5-8a9e-7ba1dba96f05',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.869154] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.249642] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.249642] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.249642] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.249642] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.249642] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.249642] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port 9b2ae488-cbe1-49c5-8a9e-7ba1dba96f05 not found, creating... [ 1144.250123] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.250463] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.250815] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.251311] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.251518] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.252079] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.252625] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.252625] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.252982] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.253259] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.253532] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: 9b2ae488-cbe1-49c5-8a9e-7ba1dba96f05 is going to be created. [ 1144.278537] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.278760] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.278871] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.279215] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.279438] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.280036] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-9b2ae488-cbe1-49c5-8a9e-7ba1dba96f05" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.372782] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.875794] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.875953] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.876134] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.876334] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.876444] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.876548] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d226a97-2d69-4706-b98b-565700008c6f is going to be updated. [ 1144.928661] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.928940] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.929065] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.929390] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.929609] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.944032] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: IN_PROGRESS for 2s [ 1145.015696] env[66502]: INFO networking_nsxv3.common.synchronization [req-208fcd6c-f02e-407d-85e5-d362ddd9e3cc req-4f5b86ba-5c52-4511-8036-636c600f1647 service nova] Enqueued Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_rules [ 1145.015870] env[66502]: INFO networking_nsxv3.common.synchronization [req-208fcd6c-f02e-407d-85e5-d362ddd9e3cc req-4f5b86ba-5c52-4511-8036-636c600f1647 service nova] Enqueued Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_members [ 1145.016023] env[66502]: INFO networking_nsxv3.common.synchronization [req-208fcd6c-f02e-407d-85e5-d362ddd9e3cc req-4f5b86ba-5c52-4511-8036-636c600f1647 service nova] Enqueued Resource ID: 9b2ae488-cbe1-49c5-8a9e-7ba1dba96f05 with Priority: HIGHEST for action port [ 1145.017403] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_rules [ 1145.017822] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_members [ 1145.017943] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b2ae488-cbe1-49c5-8a9e-7ba1dba96f05 with Priority: HIGHEST for action port [ 1145.018291] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.018417] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.018558] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.018756] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.019011] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.019923] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.020887] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.021196] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b2ae488-cbe1-49c5-8a9e-7ba1dba96f05 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.021312] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b2ae488-cbe1-49c5-8a9e-7ba1dba96f05" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.021370] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b2ae488-cbe1-49c5-8a9e-7ba1dba96f05" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.022338] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b2ae488-cbe1-49c5-8a9e-7ba1dba96f05" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.022426] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b2ae488-cbe1-49c5-8a9e-7ba1dba96f05',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1145.525525] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.525871] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.525871] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9b2ae488-cbe1-49c5-8a9e-7ba1dba96f05 with status ACTIVE [ 1145.525988] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.526080] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.526184] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.526365] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.526505] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.526609] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.526723] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.526820] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.526926] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.527012] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.527326] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.527458] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.527502] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.527689] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.527777] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.527866] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9b2ae488-cbe1-49c5-8a9e-7ba1dba96f05 is going to be updated. [ 1145.553433] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.553588] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.553588] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.553801] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.553948] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.554192] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b2ae488-cbe1-49c5-8a9e-7ba1dba96f05" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.957651] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: SUCCESS [ 1146.957978] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.957978] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.958383] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.958585] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.958875] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.959036] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.959319] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.959463] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.959621] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.976311] env[66502]: INFO networking_nsxv3.common.synchronization [req-a2ff2814-ead8-44c4-ad20-2b9d31fa89b2 req-f9d31d21-5871-432a-b049-21643f4147ad tempest-ServerMetadataNegativeTestJSON-1252537876 tempest-ServerMetadataNegativeTestJSON-1252537876-project-member] Enqueued Resource ID: b069d377-c59c-4f56-8831-a284c29b3f31 with Priority: HIGHEST for action security_group_members [ 1146.976311] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b069d377-c59c-4f56-8831-a284c29b3f31 with Priority: HIGHEST for action security_group_members [ 1146.976311] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-b069d377-c59c-4f56-8831-a284c29b3f31 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.976311] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b069d377-c59c-4f56-8831-a284c29b3f31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.976311] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b069d377-c59c-4f56-8831-a284c29b3f31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.976311] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b069d377-c59c-4f56-8831-a284c29b3f31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.976311] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.976311] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.976311] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.976841] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.976841] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.976841] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b069d377-c59c-4f56-8831-a284c29b3f31',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.463847] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.479908] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.483022] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.483022] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.483022] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.483022] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.483022] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.483022] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.483022] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.483022] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.483022] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.483022] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b069d377-c59c-4f56-8831-a284c29b3f31 is going to be updated. [ 1147.522878] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.522878] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.522878] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.522878] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.522878] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.536473] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b069d377-c59c-4f56-8831-a284c29b3f31 in Status: IN_PROGRESS for 2s [ 1147.967490] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1148.469518] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.469766] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.469821] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.470074] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.470186] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.470262] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d226a97-2d69-4706-b98b-565700008c6f is going to be updated. [ 1148.504715] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.504972] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.504972] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.505137] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.505207] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.515518] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: IN_PROGRESS for 2s [ 1148.759999] env[66502]: INFO networking_nsxv3.common.synchronization [req-61084e9c-3883-4313-a625-2a62003ccab9 req-bb6b8d2b-273e-4b1e-abe3-a1fb6e920c7b tempest-ServerRescueTestJSON-982442935 tempest-ServerRescueTestJSON-982442935-project-member] Enqueued Resource ID: 0880fb6e-a350-4602-9874-47125beb1eb3 with Priority: HIGHEST for action security_group_members [ 1148.760490] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0880fb6e-a350-4602-9874-47125beb1eb3 with Priority: HIGHEST for action security_group_members [ 1148.760990] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0880fb6e-a350-4602-9874-47125beb1eb3 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.761208] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.761257] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.761435] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.761593] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1148.761703] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1148.761751] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1148.761895] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1148.761982] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1148.762112] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0880fb6e-a350-4602-9874-47125beb1eb3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.264750] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0880fb6e-a350-4602-9874-47125beb1eb3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1149.556902] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b069d377-c59c-4f56-8831-a284c29b3f31 in Status: SUCCESS [ 1149.556902] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b069d377-c59c-4f56-8831-a284c29b3f31 deletion is rescheduled due to dependency. [ 1149.556902] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b069d377-c59c-4f56-8831-a284c29b3f31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1149.768748] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0880fb6e-a350-4602-9874-47125beb1eb3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1150.272817] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.272817] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.272817] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.273516] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.273516] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.273516] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0880fb6e-a350-4602-9874-47125beb1eb3 is going to be updated. [ 1150.323068] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.323333] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.323508] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.323948] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.324076] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.338140] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0880fb6e-a350-4602-9874-47125beb1eb3 in Status: IN_PROGRESS for 2s [ 1150.526901] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: SUCCESS [ 1150.527167] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.527314] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.527570] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.527793] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1150.527927] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1150.527984] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1150.528196] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1150.528270] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.528330] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.528452] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.031926] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.031926] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.031926] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.031926] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.032216] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.032216] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.032302] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.032446] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.032507] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.032612] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.032795] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.032919] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.033173] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.035515] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.035515] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.035515] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.035515] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.035515] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.035515] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.035515] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.035515] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1151.538428] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9d226a97-2d69-4706-b98b-565700008c6f: rpc.has_security_group_logging(os_id): False [ 1151.557446] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.557636] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.557636] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.557916] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.558022] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.558220] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.558334] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.558391] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.558618] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.558708] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.558964] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.559532] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.559614] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.559764] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.559856] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.561604] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.561604] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.561604] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.561604] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.561604] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.561604] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d226a97-2d69-4706-b98b-565700008c6f is going to be updated. [ 1151.626480] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1151.626633] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1151.626704] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1151.626937] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1151.627084] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1151.648273] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: IN_PROGRESS for 2s [ 1152.357206] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0880fb6e-a350-4602-9874-47125beb1eb3 in Status: SUCCESS [ 1152.357433] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.669268] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: SUCCESS [ 1153.669908] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1153.761871] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1153.761977] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1156.181715] env[66502]: INFO networking_nsxv3.common.synchronization [req-9e7280e3-1a23-4517-8b49-55ef9b36ba0c req-b393328a-02a2-4f58-b32e-d54d0c9f28eb tempest-ServerRescueNegativeTestJSON-1777100369 tempest-ServerRescueNegativeTestJSON-1777100369-project-member] Enqueued Resource ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 with Priority: HIGHEST for action security_group_members [ 1156.182425] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 with Priority: HIGHEST for action security_group_members [ 1156.183046] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb2d9d2-95c1-4cee-98cc-8a9106959838 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.183046] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.183046] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.186864] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.186864] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.186864] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.186864] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.186864] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.186864] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.186864] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4eb2d9d2-95c1-4cee-98cc-8a9106959838',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.686245] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4eb2d9d2-95c1-4cee-98cc-8a9106959838',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.188167] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4eb2d9d2-95c1-4cee-98cc-8a9106959838',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.690725] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.690934] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.691028] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.691295] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.691521] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.691521] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 is going to be updated. [ 1157.725704] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.725889] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.725962] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.726200] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.726350] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.736328] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 in Status: IN_PROGRESS for 2s [ 1158.180082] env[66502]: INFO networking_nsxv3.common.synchronization [req-e03e15aa-2609-4410-a15c-4722a2d83f70 req-8e08876f-435f-490c-892c-6acdd30ef1f0 tempest-ServerRescueTestJSON-982442935 tempest-ServerRescueTestJSON-982442935-project-member] Enqueued Resource ID: 0880fb6e-a350-4602-9874-47125beb1eb3 with Priority: HIGHEST for action security_group_members [ 1158.180922] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0880fb6e-a350-4602-9874-47125beb1eb3 with Priority: HIGHEST for action security_group_members [ 1158.181196] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-0880fb6e-a350-4602-9874-47125beb1eb3 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.181410] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.181447] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.181665] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.181825] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.181927] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.181991] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.182480] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.182575] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.182674] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0880fb6e-a350-4602-9874-47125beb1eb3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.193253] env[66502]: INFO networking_nsxv3.common.synchronization [req-fb13f96c-8e61-435e-9d0c-1bcf5475f837 req-0b2be2a1-7fe5-40ae-8731-f7aefecf42e9 tempest-AttachVolumeNegativeTest-686526601 tempest-AttachVolumeNegativeTest-686526601-project-member] Enqueued Resource ID: d9e364d3-a93f-4a56-a513-11d45b81aadf with Priority: HIGHEST for action security_group_members [ 1158.193576] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9e364d3-a93f-4a56-a513-11d45b81aadf with Priority: HIGHEST for action security_group_members [ 1158.194536] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-d9e364d3-a93f-4a56-a513-11d45b81aadf taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.194536] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d9e364d3-a93f-4a56-a513-11d45b81aadf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.194536] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d9e364d3-a93f-4a56-a513-11d45b81aadf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.194746] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d9e364d3-a93f-4a56-a513-11d45b81aadf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.194746] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.194919] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.194919] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.195032] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.195115] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.195208] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d9e364d3-a93f-4a56-a513-11d45b81aadf',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1158.684719] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.684938] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.684938] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.685356] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.685462] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.685668] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.685768] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.685823] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.685992] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.686084] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.686173] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0880fb6e-a350-4602-9874-47125beb1eb3 is going to be updated. [ 1158.697417] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.697818] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.697818] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.697967] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.698122] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.698352] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.698468] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.698541] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.698671] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.698737] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.698833] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9e364d3-a93f-4a56-a513-11d45b81aadf is going to be updated. [ 1158.716642] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.716855] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.716855] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.716952] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.717109] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.725818] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0880fb6e-a350-4602-9874-47125beb1eb3 in Status: IN_PROGRESS for 2s [ 1158.731395] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1158.731538] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1158.731608] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1158.731823] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1158.731962] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1158.740823] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9e364d3-a93f-4a56-a513-11d45b81aadf in Status: IN_PROGRESS for 2s [ 1159.748727] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 in Status: SUCCESS [ 1159.749081] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.739571] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0880fb6e-a350-4602-9874-47125beb1eb3 in Status: SUCCESS [ 1160.739738] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0880fb6e-a350-4602-9874-47125beb1eb3 deletion is rescheduled due to dependency. [ 1160.739832] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.749400] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d9e364d3-a93f-4a56-a513-11d45b81aadf in Status: SUCCESS [ 1160.750327] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d9e364d3-a93f-4a56-a513-11d45b81aadf deletion is rescheduled due to dependency. [ 1160.750327] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d9e364d3-a93f-4a56-a513-11d45b81aadf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.800345] env[66502]: INFO networking_nsxv3.common.synchronization [req-bdfd894b-6f4a-4d3f-bd20-55459da89c44 req-7c414b17-e39f-48fb-a8bc-6e53ca881af8 tempest-ServersTestJSON-1210226259 tempest-ServersTestJSON-1210226259-project-member] Enqueued Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_members [ 1160.800584] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_members [ 1160.800855] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.801179] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.801300] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.801634] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.801725] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.801820] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.801914] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.802107] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.802213] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.802292] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.305165] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1161.808485] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1162.311034] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.311267] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.311349] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.311645] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.311785] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.311898] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d226a97-2d69-4706-b98b-565700008c6f is going to be updated. [ 1162.358612] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1162.358612] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1162.358754] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1162.358891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1162.359343] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1162.369212] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: IN_PROGRESS for 2s [ 1164.392956] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: SUCCESS [ 1164.393323] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.801760] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1165.801760] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1166.469198] env[66502]: INFO networking_nsxv3.common.synchronization [req-c1a6c7a7-3543-49fd-910b-222224b40555 req-4a764977-2a22-45fa-96cc-774e6883970a tempest-DeleteServersTestJSON-51385704 tempest-DeleteServersTestJSON-51385704-project-member] Enqueued Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_members [ 1166.469725] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea with Priority: HIGHEST for action security_group_members [ 1166.470059] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-704e5eab-aa44-4493-8c9a-0b24250e7bea taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.470270] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.470270] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.470480] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.470636] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.470725] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.470792] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.471077] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.471077] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.471198] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('704e5eab-aa44-4493-8c9a-0b24250e7bea',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.974173] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.974662] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.974662] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.974921] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.975063] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.975328] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.975525] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.975642] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.975763] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.975862] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.975986] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea is going to be updated. [ 1167.005519] env[66502]: INFO networking_nsxv3.common.synchronization [req-e975f678-620b-4bdc-b42e-d4df4c9268af req-79b0562e-bcc2-4c50-a94b-309873bf3783 tempest-ServerRescueNegativeTestJSON-1777100369 tempest-ServerRescueNegativeTestJSON-1777100369-project-member] Enqueued Resource ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 with Priority: HIGHEST for action security_group_members [ 1167.006586] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 with Priority: HIGHEST for action security_group_members [ 1167.006984] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4eb2d9d2-95c1-4cee-98cc-8a9106959838 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.007838] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.007994] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.008314] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.009043] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.009277] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.009348] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.009541] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.009662] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.009742] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4eb2d9d2-95c1-4cee-98cc-8a9106959838',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.018850] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.018850] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.018850] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.018850] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.018850] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.029104] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: IN_PROGRESS for 2s [ 1167.515531] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.515692] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.515761] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.516101] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.517109] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.517109] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.517109] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.517109] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.517109] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.517109] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.517109] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 is going to be updated. [ 1167.550976] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.551167] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.551260] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.551859] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.552080] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.562460] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 in Status: IN_PROGRESS for 2s [ 1169.041792] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea in Status: SUCCESS [ 1169.042109] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 704e5eab-aa44-4493-8c9a-0b24250e7bea deletion is rescheduled due to dependency. [ 1169.042151] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-704e5eab-aa44-4493-8c9a-0b24250e7bea" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.578034] env[66502]: INFO networking_nsxv3.common.synchronization [None req-a4205213-8dfe-44ef-90e5-2a3dd86ded29 tempest-AttachVolumeNegativeTest-686526601 tempest-AttachVolumeNegativeTest-686526601-project-member] Enqueued Resource ID: bf700520-a5f6-400c-a90d-a385e198aebe with Priority: HIGHEST for action security_group_rules [ 1169.578034] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 in Status: SUCCESS [ 1169.578034] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 deletion is rescheduled due to dependency. [ 1169.578626] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.579332] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf700520-a5f6-400c-a90d-a385e198aebe with Priority: HIGHEST for action security_group_rules [ 1169.579789] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf700520-a5f6-400c-a90d-a385e198aebe taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.580090] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf700520-a5f6-400c-a90d-a385e198aebe" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.580197] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf700520-a5f6-400c-a90d-a385e198aebe" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.581488] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf700520-a5f6-400c-a90d-a385e198aebe" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.581488] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf700520-a5f6-400c-a90d-a385e198aebe',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.744438] env[66502]: INFO networking_nsxv3.common.synchronization [None req-14f2aab8-37f7-4c13-9599-de9c70fec8ab tempest-AttachVolumeNegativeTest-686526601 tempest-AttachVolumeNegativeTest-686526601-project-member] Enqueued Resource ID: bf700520-a5f6-400c-a90d-a385e198aebe with Priority: HIGHEST for action security_group_rules [ 1169.747769] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf700520-a5f6-400c-a90d-a385e198aebe with Priority: HIGHEST for action security_group_rules [ 1169.747769] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf700520-a5f6-400c-a90d-a385e198aebe taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.747769] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf700520-a5f6-400c-a90d-a385e198aebe" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.105938] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.105938] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.105938] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.105938] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.105938] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.105938] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf700520-a5f6-400c-a90d-a385e198aebe already deleted. [ 1170.105938] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf700520-a5f6-400c-a90d-a385e198aebe" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.105938] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf700520-a5f6-400c-a90d-a385e198aebe" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.105938] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf700520-a5f6-400c-a90d-a385e198aebe" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.105938] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf700520-a5f6-400c-a90d-a385e198aebe',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.626472] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.626641] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.626699] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.626902] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.626992] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.627103] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf700520-a5f6-400c-a90d-a385e198aebe already deleted. [ 1170.627185] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf700520-a5f6-400c-a90d-a385e198aebe" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.322027] env[66502]: INFO networking_nsxv3.common.synchronization [None req-74e5f3ae-2620-4ef6-b218-8f88f2c4dee9 None None] Enqueued Resource ID: e26033b5-876e-440e-8dab-876f6bc2db6e with Priority: HIGHEST for action port [ 1171.323122] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e26033b5-876e-440e-8dab-876f6bc2db6e with Priority: HIGHEST for action port [ 1171.323711] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-e26033b5-876e-440e-8dab-876f6bc2db6e taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.323971] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e26033b5-876e-440e-8dab-876f6bc2db6e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.324157] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e26033b5-876e-440e-8dab-876f6bc2db6e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.324527] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e26033b5-876e-440e-8dab-876f6bc2db6e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.324626] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e26033b5-876e-440e-8dab-876f6bc2db6e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.827241] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e26033b5-876e-440e-8dab-876f6bc2db6e [ 1171.827583] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.827726] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.827794] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.828035] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.828190] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.828297] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e26033b5-876e-440e-8dab-876f6bc2db6e already deleted. [ 1171.828385] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e26033b5-876e-440e-8dab-876f6bc2db6e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.690832] env[66502]: INFO networking_nsxv3.common.synchronization [None req-54037163-414d-4a4e-90fc-851cc68ab725 None None] Enqueued Resource ID: d409f467-7d21-4cc8-af2a-3bcb0d618fa4 with Priority: HIGHEST for action port [ 1173.690832] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d409f467-7d21-4cc8-af2a-3bcb0d618fa4 with Priority: HIGHEST for action port [ 1173.690832] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-d409f467-7d21-4cc8-af2a-3bcb0d618fa4 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.691519] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d409f467-7d21-4cc8-af2a-3bcb0d618fa4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.691519] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d409f467-7d21-4cc8-af2a-3bcb0d618fa4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.691519] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d409f467-7d21-4cc8-af2a-3bcb0d618fa4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.691519] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d409f467-7d21-4cc8-af2a-3bcb0d618fa4',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.856368] env[66502]: INFO networking_nsxv3.common.synchronization [req-3fe3e809-0a36-4423-b956-b66e43fa7441 req-905a5f75-6229-4e86-a22f-042cf768d843 tempest-ServersTestJSON-1210226259 tempest-ServersTestJSON-1210226259-project-member] Enqueued Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_members [ 1173.860367] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGHEST for action security_group_members [ 1173.860367] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.860367] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.860367] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.860367] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.860367] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.860367] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.860367] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.860367] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.860367] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.860367] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.195459] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d409f467-7d21-4cc8-af2a-3bcb0d618fa4 [ 1174.195764] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.195932] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.195932] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.196135] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.196247] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.196308] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d409f467-7d21-4cc8-af2a-3bcb0d618fa4 already deleted. [ 1174.196393] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d409f467-7d21-4cc8-af2a-3bcb0d618fa4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.365904] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.366096] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.366096] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.366264] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.366360] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.366720] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.366720] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.366864] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.366896] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.366961] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.367123] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d226a97-2d69-4706-b98b-565700008c6f is going to be updated. [ 1174.398556] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.398763] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.398950] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.399009] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.399179] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.409938] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: IN_PROGRESS for 2s [ 1176.424758] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9d226a97-2d69-4706-b98b-565700008c6f in Status: SUCCESS [ 1176.425260] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9d226a97-2d69-4706-b98b-565700008c6f deletion is rescheduled due to dependency. [ 1176.425439] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.721131] env[66502]: INFO networking_nsxv3.common.synchronization [None req-a260e503-a182-4d58-9606-8c8064d4fe0f None None] Enqueued Resource ID: cab573f8-c5e0-4157-bd29-cdc337bbe289 with Priority: HIGHEST for action port [ 1178.721566] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cab573f8-c5e0-4157-bd29-cdc337bbe289 with Priority: HIGHEST for action port [ 1178.721674] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-cab573f8-c5e0-4157-bd29-cdc337bbe289 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.721793] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cab573f8-c5e0-4157-bd29-cdc337bbe289" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.721793] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cab573f8-c5e0-4157-bd29-cdc337bbe289" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.725877] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cab573f8-c5e0-4157-bd29-cdc337bbe289" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.725953] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cab573f8-c5e0-4157-bd29-cdc337bbe289',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.864930] env[66502]: INFO networking_nsxv3.common.synchronization [req-27b11586-c385-4fd8-bcd4-59feac62a5b0 req-ab9a73b4-ced0-47b5-b01c-e7cb7cb01bc7 tempest-AttachVolumeNegativeTest-686526601 tempest-AttachVolumeNegativeTest-686526601-project-member] Enqueued Resource ID: bf700520-a5f6-400c-a90d-a385e198aebe with Priority: HIGHEST for action security_group_members [ 1178.865559] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf700520-a5f6-400c-a90d-a385e198aebe with Priority: HIGHEST for action security_group_members [ 1178.865876] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf700520-a5f6-400c-a90d-a385e198aebe taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.866020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf700520-a5f6-400c-a90d-a385e198aebe" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.866593] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf700520-a5f6-400c-a90d-a385e198aebe" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.867848] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf700520-a5f6-400c-a90d-a385e198aebe" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.867941] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.868038] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.868120] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.869056] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.869056] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.869056] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf700520-a5f6-400c-a90d-a385e198aebe',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.228087] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cab573f8-c5e0-4157-bd29-cdc337bbe289 [ 1179.229655] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.229655] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.229655] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.229655] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.229655] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.229655] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cab573f8-c5e0-4157-bd29-cdc337bbe289 already deleted. [ 1179.229655] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cab573f8-c5e0-4157-bd29-cdc337bbe289" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.274645] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-647 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.274840] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-647" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.274956] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-647" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.279169] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-647" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.279169] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.279169] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.279169] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.279169] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.279169] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.279169] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1179.279169] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1179.279169] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1179.279169] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1179.279169] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1179.279169] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1179.279169] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1179.303547] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1179.303547] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1179.303667] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1179.303826] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-647" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.304154] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-65941a66-bb93-405b-9ccb-0dc0c28eab8d taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.304363] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-65941a66-bb93-405b-9ccb-0dc0c28eab8d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.304441] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-65941a66-bb93-405b-9ccb-0dc0c28eab8d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.304784] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-65941a66-bb93-405b-9ccb-0dc0c28eab8d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.304923] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65941a66-bb93-405b-9ccb-0dc0c28eab8d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.374269] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.374462] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.374538] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.374780] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.374886] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.375178] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.375290] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.375356] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.375551] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.375634] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.375738] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf700520-a5f6-400c-a90d-a385e198aebe already deleted. [ 1179.375841] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf700520-a5f6-400c-a90d-a385e198aebe" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.810482] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.811406] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.811406] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.811406] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.811406] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.811406] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port 65941a66-bb93-405b-9ccb-0dc0c28eab8d not found, creating... [ 1179.811656] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.812201] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.812201] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.812201] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.812402] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.812747] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.812917] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.813135] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.813282] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.813466] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.813553] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: 65941a66-bb93-405b-9ccb-0dc0c28eab8d is going to be created. [ 1179.836831] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.837188] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.837188] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.837435] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.837630] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.837863] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-65941a66-bb93-405b-9ccb-0dc0c28eab8d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.566620] env[66502]: INFO networking_nsxv3.common.synchronization [req-27b11586-c385-4fd8-bcd4-59feac62a5b0 req-4b3bb5dd-cdf6-4868-9fdb-8e199904ac9d service nova] Enqueued Resource ID: bf700520-a5f6-400c-a90d-a385e198aebe with Priority: HIGHEST for action security_group_rules [ 1180.566962] env[66502]: INFO networking_nsxv3.common.synchronization [req-27b11586-c385-4fd8-bcd4-59feac62a5b0 req-4b3bb5dd-cdf6-4868-9fdb-8e199904ac9d service nova] Enqueued Resource ID: bf700520-a5f6-400c-a90d-a385e198aebe with Priority: HIGHEST for action security_group_members [ 1180.566962] env[66502]: INFO networking_nsxv3.common.synchronization [req-27b11586-c385-4fd8-bcd4-59feac62a5b0 req-4b3bb5dd-cdf6-4868-9fdb-8e199904ac9d service nova] Enqueued Resource ID: 65941a66-bb93-405b-9ccb-0dc0c28eab8d with Priority: HIGHEST for action port [ 1180.567132] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf700520-a5f6-400c-a90d-a385e198aebe with Priority: HIGHEST for action security_group_rules [ 1180.569207] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf700520-a5f6-400c-a90d-a385e198aebe with Priority: HIGHEST for action security_group_members [ 1180.569207] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 65941a66-bb93-405b-9ccb-0dc0c28eab8d with Priority: HIGHEST for action port [ 1180.569207] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf700520-a5f6-400c-a90d-a385e198aebe taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.569207] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf700520-a5f6-400c-a90d-a385e198aebe" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.569207] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf700520-a5f6-400c-a90d-a385e198aebe" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.569207] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf700520-a5f6-400c-a90d-a385e198aebe" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.569207] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf700520-a5f6-400c-a90d-a385e198aebe',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.569799] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf700520-a5f6-400c-a90d-a385e198aebe taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.569799] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf700520-a5f6-400c-a90d-a385e198aebe" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.569969] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf700520-a5f6-400c-a90d-a385e198aebe" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.570603] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf700520-a5f6-400c-a90d-a385e198aebe" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.570603] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.570603] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.570603] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.573966] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.575081] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.575081] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf700520-a5f6-400c-a90d-a385e198aebe',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.575204] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-65941a66-bb93-405b-9ccb-0dc0c28eab8d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.575325] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-65941a66-bb93-405b-9ccb-0dc0c28eab8d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.575420] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-65941a66-bb93-405b-9ccb-0dc0c28eab8d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.575616] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-65941a66-bb93-405b-9ccb-0dc0c28eab8d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.575713] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('65941a66-bb93-405b-9ccb-0dc0c28eab8d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.901614] env[66502]: INFO networking_nsxv3.common.synchronization [None req-8de64ba7-7175-4207-b5e1-1c3c8473fce5 None None] Enqueued Resource ID: 51da605f-6eb6-425a-aff7-8b1d2b57103d with Priority: HIGHEST for action port [ 1180.902119] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51da605f-6eb6-425a-aff7-8b1d2b57103d with Priority: HIGHEST for action port [ 1180.902532] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-51da605f-6eb6-425a-aff7-8b1d2b57103d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.903040] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51da605f-6eb6-425a-aff7-8b1d2b57103d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.903115] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51da605f-6eb6-425a-aff7-8b1d2b57103d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.903929] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51da605f-6eb6-425a-aff7-8b1d2b57103d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.903929] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51da605f-6eb6-425a-aff7-8b1d2b57103d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.082723] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('bf700520-a5f6-400c-a90d-a385e198aebe',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.082723] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf700520-a5f6-400c-a90d-a385e198aebe taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.082723] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf700520-a5f6-400c-a90d-a385e198aebe" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.082723] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 65941a66-bb93-405b-9ccb-0dc0c28eab8d with status ACTIVE [ 1181.082723] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.082723] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.082723] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.082723] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.082723] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.082723] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.082723] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.082723] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.082723] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.082723] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.083725] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.083725] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.083725] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.084466] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.085027] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.085027] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 65941a66-bb93-405b-9ccb-0dc0c28eab8d is going to be updated. [ 1181.111759] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.111976] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.111976] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.112197] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.112328] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.112496] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-65941a66-bb93-405b-9ccb-0dc0c28eab8d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.286046] env[66502]: INFO networking_nsxv3.common.synchronization [req-dbefe206-6802-4ce0-a3b1-0acd4871ff02 req-951d802c-81d6-446e-a549-c3778b7fdd96 tempest-ServerActionsTestOtherA-1204678764 tempest-ServerActionsTestOtherA-1204678764-project-member] Enqueued Resource ID: da4454aa-c9b4-48df-a3af-94b687746e31 with Priority: HIGHEST for action security_group_members [ 1181.287203] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da4454aa-c9b4-48df-a3af-94b687746e31 with Priority: HIGHEST for action security_group_members [ 1181.289267] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-da4454aa-c9b4-48df-a3af-94b687746e31 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.289447] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.289554] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.289946] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.290189] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.290374] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.290456] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.290693] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.290998] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.290998] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da4454aa-c9b4-48df-a3af-94b687746e31',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.405839] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 51da605f-6eb6-425a-aff7-8b1d2b57103d [ 1181.405839] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.405839] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.405839] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.405839] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.405839] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.406656] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:51da605f-6eb6-425a-aff7-8b1d2b57103d already deleted. [ 1181.406656] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51da605f-6eb6-425a-aff7-8b1d2b57103d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.588015] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('bf700520-a5f6-400c-a90d-a385e198aebe',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.751900] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-170 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.752157] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-170" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.752231] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-170" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.752500] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-170" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.752790] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.752942] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.753463] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.753715] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.753880] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.754110] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1181.754457] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1181.754540] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1181.754606] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1181.754718] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1181.754899] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1181.755062] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1181.776979] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1181.777230] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1181.777365] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1181.777617] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-170" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.778114] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-b31f3d18-3080-4a85-b0ea-5a14b0f5d08e taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.778679] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-b31f3d18-3080-4a85-b0ea-5a14b0f5d08e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.778679] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-b31f3d18-3080-4a85-b0ea-5a14b0f5d08e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.778949] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-b31f3d18-3080-4a85-b0ea-5a14b0f5d08e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.779611] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b31f3d18-3080-4a85-b0ea-5a14b0f5d08e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.793462] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.793626] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.793695] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.793920] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.797067] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.797067] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.797067] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.797067] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.797067] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.797067] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.797067] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da4454aa-c9b4-48df-a3af-94b687746e31 already deleted. [ 1181.797067] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.090241] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.090689] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.090689] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.090799] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.090844] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.091159] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf700520-a5f6-400c-a90d-a385e198aebe is going to be created. [ 1182.117108] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.117330] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.117478] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.117854] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.118322] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.130507] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf700520-a5f6-400c-a90d-a385e198aebe in Status: UNINITIALIZED for 2s [ 1182.185025] env[66502]: INFO networking_nsxv3.common.synchronization [req-4bec5bff-b6e1-4c24-9378-2fe6f1b24e36 req-d78d4a10-02bb-455d-8f4f-3a9a478ace93 tempest-AttachInterfacesTestJSON-1531294335 tempest-AttachInterfacesTestJSON-1531294335-project-member] Enqueued Resource ID: 3f796883-7322-4113-bfa9-5a64b4903a46 with Priority: HIGHEST for action security_group_members [ 1182.185811] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f796883-7322-4113-bfa9-5a64b4903a46 with Priority: HIGHEST for action security_group_members [ 1182.186264] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f796883-7322-4113-bfa9-5a64b4903a46 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.186430] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.186679] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.186742] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.186851] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.186956] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.187061] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.187167] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.187262] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.187353] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f796883-7322-4113-bfa9-5a64b4903a46',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.284022] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.284251] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.284401] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.284746] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.284899] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.285069] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port b31f3d18-3080-4a85-b0ea-5a14b0f5d08e not found, creating... [ 1182.285352] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.285488] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.285604] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.285818] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.285955] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.286244] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.286397] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.286512] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.286719] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.286850] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.286989] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: b31f3d18-3080-4a85-b0ea-5a14b0f5d08e is going to be created. [ 1182.308296] env[66502]: INFO networking_nsxv3.common.synchronization [None req-632ac5b4-bc26-4b45-b4ba-038a76c1624a None None] Enqueued Resource ID: fff441f4-7fcf-450c-b3a3-7680f297aee9 with Priority: HIGHEST for action port [ 1182.308943] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fff441f4-7fcf-450c-b3a3-7680f297aee9 with Priority: HIGHEST for action port [ 1182.309279] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-fff441f4-7fcf-450c-b3a3-7680f297aee9 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.309407] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fff441f4-7fcf-450c-b3a3-7680f297aee9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.309479] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fff441f4-7fcf-450c-b3a3-7680f297aee9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.309751] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fff441f4-7fcf-450c-b3a3-7680f297aee9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.309842] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fff441f4-7fcf-450c-b3a3-7680f297aee9',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.316171] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.316435] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.316589] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.316889] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.317134] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.317363] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-b31f3d18-3080-4a85-b0ea-5a14b0f5d08e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.631829] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-584 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.632313] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-584" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.632313] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-584" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.632495] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-584" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.632770] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.632770] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.633024] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.633530] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.633690] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.633903] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1182.634026] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1182.634137] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1182.634245] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1182.634354] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1182.634460] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1182.634588] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1182.655923] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1182.656106] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1182.656266] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1182.656412] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-584" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.656733] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-4bdbf4ce-ca23-4de7-a880-0a413b575fe8 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.656935] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-4bdbf4ce-ca23-4de7-a880-0a413b575fe8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.657071] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-4bdbf4ce-ca23-4de7-a880-0a413b575fe8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.657412] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-4bdbf4ce-ca23-4de7-a880-0a413b575fe8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.657560] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bdbf4ce-ca23-4de7-a880-0a413b575fe8',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.690175] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.690417] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.690534] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.690667] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.690741] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.690943] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.691059] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.691122] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.691247] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.691495] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.691665] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f796883-7322-4113-bfa9-5a64b4903a46 is going to be updated. [ 1182.720241] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.720474] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.720474] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.720666] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.720808] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.730815] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f796883-7322-4113-bfa9-5a64b4903a46 in Status: IN_PROGRESS for 2s [ 1182.813429] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fff441f4-7fcf-450c-b3a3-7680f297aee9 [ 1182.813677] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.813867] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.813949] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.814222] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.814311] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.814379] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fff441f4-7fcf-450c-b3a3-7680f297aee9 already deleted. [ 1182.814460] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fff441f4-7fcf-450c-b3a3-7680f297aee9" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.007186] env[66502]: INFO networking_nsxv3.common.synchronization [req-dbefe206-6802-4ce0-a3b1-0acd4871ff02 req-f283fb6a-552b-4de0-a8e7-4fa4138af27f service nova] Enqueued Resource ID: da4454aa-c9b4-48df-a3af-94b687746e31 with Priority: HIGHEST for action security_group_rules [ 1183.007186] env[66502]: INFO networking_nsxv3.common.synchronization [req-dbefe206-6802-4ce0-a3b1-0acd4871ff02 req-f283fb6a-552b-4de0-a8e7-4fa4138af27f service nova] Enqueued Resource ID: da4454aa-c9b4-48df-a3af-94b687746e31 with Priority: HIGHEST for action security_group_members [ 1183.007186] env[66502]: INFO networking_nsxv3.common.synchronization [req-dbefe206-6802-4ce0-a3b1-0acd4871ff02 req-f283fb6a-552b-4de0-a8e7-4fa4138af27f service nova] Enqueued Resource ID: b31f3d18-3080-4a85-b0ea-5a14b0f5d08e with Priority: HIGHEST for action port [ 1183.007778] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da4454aa-c9b4-48df-a3af-94b687746e31 with Priority: HIGHEST for action security_group_rules [ 1183.007778] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da4454aa-c9b4-48df-a3af-94b687746e31 with Priority: HIGHEST for action security_group_members [ 1183.007778] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b31f3d18-3080-4a85-b0ea-5a14b0f5d08e with Priority: HIGHEST for action port [ 1183.008271] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da4454aa-c9b4-48df-a3af-94b687746e31 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.008442] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.008540] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.008938] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.008938] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da4454aa-c9b4-48df-a3af-94b687746e31',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.011299] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-da4454aa-c9b4-48df-a3af-94b687746e31 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.011299] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.011299] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.011299] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.011299] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.011299] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.011299] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.011299] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.011299] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.011299] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da4454aa-c9b4-48df-a3af-94b687746e31',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.012241] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-b31f3d18-3080-4a85-b0ea-5a14b0f5d08e taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.012339] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b31f3d18-3080-4a85-b0ea-5a14b0f5d08e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.012458] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b31f3d18-3080-4a85-b0ea-5a14b0f5d08e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.012613] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b31f3d18-3080-4a85-b0ea-5a14b0f5d08e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.012718] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b31f3d18-3080-4a85-b0ea-5a14b0f5d08e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.163973] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.164273] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.164406] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.164744] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.165055] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.165255] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 4bdbf4ce-ca23-4de7-a880-0a413b575fe8 not found, creating... [ 1183.165541] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.165730] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.165848] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.166076] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.166246] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.166540] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.166694] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.166806] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.167016] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.167185] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.167340] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 4bdbf4ce-ca23-4de7-a880-0a413b575fe8 is going to be created. [ 1183.189452] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.189656] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.189779] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.190073] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.190391] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.190583] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-4bdbf4ce-ca23-4de7-a880-0a413b575fe8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.515630] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-da4454aa-c9b4-48df-a3af-94b687746e31 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.515630] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.515630] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da4454aa-c9b4-48df-a3af-94b687746e31',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.515922] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b31f3d18-3080-4a85-b0ea-5a14b0f5d08e with status ACTIVE [ 1183.516071] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.516183] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.516249] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.516990] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.516990] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.516990] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.516990] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.516990] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.517239] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.517239] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.517309] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.517354] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.517442] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.517539] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.517615] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.517703] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b31f3d18-3080-4a85-b0ea-5a14b0f5d08e is going to be updated. [ 1183.540827] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.540990] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.541044] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.541771] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.542296] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.542504] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b31f3d18-3080-4a85-b0ea-5a14b0f5d08e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.697716] env[66502]: INFO networking_nsxv3.common.synchronization [req-d70c01ee-ecc2-44af-8047-652d8d048a4c req-1d7a678f-2100-49f7-8162-a2bc5bae310f tempest-ServerTagsTestJSON-586476178 tempest-ServerTagsTestJSON-586476178-project-member] Enqueued Resource ID: afe84ec2-d66d-4a72-afc0-223b05dddb60 with Priority: HIGHEST for action security_group_members [ 1183.698395] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afe84ec2-d66d-4a72-afc0-223b05dddb60 with Priority: HIGHEST for action security_group_members [ 1183.699141] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-afe84ec2-d66d-4a72-afc0-223b05dddb60 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.699316] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-afe84ec2-d66d-4a72-afc0-223b05dddb60" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.699397] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-afe84ec2-d66d-4a72-afc0-223b05dddb60" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.699700] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-afe84ec2-d66d-4a72-afc0-223b05dddb60" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.700627] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.700777] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.700859] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.701139] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.701236] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.701348] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('afe84ec2-d66d-4a72-afc0-223b05dddb60',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.898273] env[66502]: INFO networking_nsxv3.common.synchronization [req-4bec5bff-b6e1-4c24-9378-2fe6f1b24e36 req-814a83ac-5290-410d-b07f-a77125d19b7e service nova] Enqueued Resource ID: 3f796883-7322-4113-bfa9-5a64b4903a46 with Priority: HIGHEST for action security_group_rules [ 1183.898273] env[66502]: INFO networking_nsxv3.common.synchronization [req-4bec5bff-b6e1-4c24-9378-2fe6f1b24e36 req-814a83ac-5290-410d-b07f-a77125d19b7e service nova] Enqueued Resource ID: 3f796883-7322-4113-bfa9-5a64b4903a46 with Priority: HIGHEST for action security_group_members [ 1183.898273] env[66502]: INFO networking_nsxv3.common.synchronization [req-4bec5bff-b6e1-4c24-9378-2fe6f1b24e36 req-814a83ac-5290-410d-b07f-a77125d19b7e service nova] Enqueued Resource ID: 4bdbf4ce-ca23-4de7-a880-0a413b575fe8 with Priority: HIGHEST for action port [ 1183.898273] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f796883-7322-4113-bfa9-5a64b4903a46 with Priority: HIGHEST for action security_group_rules [ 1183.898273] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f796883-7322-4113-bfa9-5a64b4903a46 with Priority: HIGHEST for action security_group_members [ 1183.898273] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4bdbf4ce-ca23-4de7-a880-0a413b575fe8 with Priority: HIGHEST for action port [ 1183.900066] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f796883-7322-4113-bfa9-5a64b4903a46 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.900066] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.900066] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.900066] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.900066] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f796883-7322-4113-bfa9-5a64b4903a46',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.904022] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f796883-7322-4113-bfa9-5a64b4903a46 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.904022] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.904022] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-4bdbf4ce-ca23-4de7-a880-0a413b575fe8 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.904022] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4bdbf4ce-ca23-4de7-a880-0a413b575fe8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.904022] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4bdbf4ce-ca23-4de7-a880-0a413b575fe8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.904022] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4bdbf4ce-ca23-4de7-a880-0a413b575fe8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.904022] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4bdbf4ce-ca23-4de7-a880-0a413b575fe8',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.020820] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da4454aa-c9b4-48df-a3af-94b687746e31',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.041631] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-106 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.042618] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-106" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.042618] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-106" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.043520] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-106" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.043520] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.043520] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.043739] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.044801] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.044801] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.044801] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1184.044801] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1184.044801] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1184.044801] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1184.044801] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1184.044801] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1184.045282] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1184.064584] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1184.064755] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1184.064919] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1184.065128] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-106" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.065485] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-dc11c175-ef38-4209-ac43-24f45ffbe411 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.065671] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-dc11c175-ef38-4209-ac43-24f45ffbe411" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.065789] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-dc11c175-ef38-4209-ac43-24f45ffbe411" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.066114] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-dc11c175-ef38-4209-ac43-24f45ffbe411" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.066268] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc11c175-ef38-4209-ac43-24f45ffbe411',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.141466] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf700520-a5f6-400c-a90d-a385e198aebe in Status: SUCCESS [ 1184.141812] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf700520-a5f6-400c-a90d-a385e198aebe" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.142042] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf700520-a5f6-400c-a90d-a385e198aebe" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.142306] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf700520-a5f6-400c-a90d-a385e198aebe" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.142581] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.142736] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.142804] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.142964] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.143061] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.143148] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf700520-a5f6-400c-a90d-a385e198aebe" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.143237] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('bf700520-a5f6-400c-a90d-a385e198aebe',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.203676] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.204533] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.204533] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.204533] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.204533] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.204533] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.204732] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.204732] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.204807] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.204839] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.204900] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: afe84ec2-d66d-4a72-afc0-223b05dddb60 already deleted. [ 1184.204989] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-afe84ec2-d66d-4a72-afc0-223b05dddb60" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.292488] env[66502]: INFO networking_nsxv3.common.synchronization [None req-ed819b73-a570-4d26-ac4d-8ecfb67bc32e None None] Enqueued Resource ID: db9e64b8-7b82-4c60-a6d7-e973855f11d2 with Priority: HIGHEST for action port [ 1184.293089] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: db9e64b8-7b82-4c60-a6d7-e973855f11d2 with Priority: HIGHEST for action port [ 1184.293391] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-db9e64b8-7b82-4c60-a6d7-e973855f11d2 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.293510] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-db9e64b8-7b82-4c60-a6d7-e973855f11d2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.294615] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-db9e64b8-7b82-4c60-a6d7-e973855f11d2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.298850] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-db9e64b8-7b82-4c60-a6d7-e973855f11d2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.298978] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('db9e64b8-7b82-4c60-a6d7-e973855f11d2',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.406233] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f796883-7322-4113-bfa9-5a64b4903a46 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.406405] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.406645] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4bdbf4ce-ca23-4de7-a880-0a413b575fe8 with status ACTIVE [ 1184.406938] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.407100] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.407174] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.407390] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.407528] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.407693] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.407761] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.407793] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.408033] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.408147] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.408395] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.408529] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.408610] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.408776] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.408872] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.408975] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4bdbf4ce-ca23-4de7-a880-0a413b575fe8 is going to be updated. [ 1184.439415] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.439621] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.439621] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.439915] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.440134] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.440299] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4bdbf4ce-ca23-4de7-a880-0a413b575fe8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.524121] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.524329] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.524412] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.524662] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.524784] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.524898] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da4454aa-c9b4-48df-a3af-94b687746e31 is going to be created. [ 1184.561368] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.561592] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.561666] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.561869] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.562106] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.568627] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.568899] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.569109] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.569911] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.569911] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.569911] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port dc11c175-ef38-4209-ac43-24f45ffbe411 not found, creating... [ 1184.570200] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.570434] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.570622] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.570902] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.571027] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.571369] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.571557] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.571695] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.571993] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.572738] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.572738] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: dc11c175-ef38-4209-ac43-24f45ffbe411 is going to be created. [ 1184.574297] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da4454aa-c9b4-48df-a3af-94b687746e31 in Status: UNINITIALIZED for 2s [ 1184.621767] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.622107] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.622308] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.622727] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.623738] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.623738] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-dc11c175-ef38-4209-ac43-24f45ffbe411" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.647858] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('bf700520-a5f6-400c-a90d-a385e198aebe',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.744539] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f796883-7322-4113-bfa9-5a64b4903a46 in Status: SUCCESS [ 1184.744539] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f796883-7322-4113-bfa9-5a64b4903a46 deletion is rescheduled due to dependency. [ 1184.744539] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.744539] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.744539] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.744539] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.744539] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.744539] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.744539] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.744539] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.744539] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f796883-7322-4113-bfa9-5a64b4903a46',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1184.802618] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port db9e64b8-7b82-4c60-a6d7-e973855f11d2 [ 1184.803088] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.803303] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.803432] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.803755] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.803929] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.804103] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:db9e64b8-7b82-4c60-a6d7-e973855f11d2 already deleted. [ 1184.804282] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-db9e64b8-7b82-4c60-a6d7-e973855f11d2" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.148629] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for bf700520-a5f6-400c-a90d-a385e198aebe: rpc.has_security_group_logging(os_id): False [ 1185.174020] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.174020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.174020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.174020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.174020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.174020] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.174020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.174020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.174020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.174020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.174020] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf700520-a5f6-400c-a90d-a385e198aebe is going to be created. [ 1185.237275] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.237725] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.237725] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.237725] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.238118] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.245834] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3f796883-7322-4113-bfa9-5a64b4903a46',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.250352] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf700520-a5f6-400c-a90d-a385e198aebe in Status: IN_PROGRESS for 2s [ 1185.359919] env[66502]: INFO networking_nsxv3.common.synchronization [req-d70c01ee-ecc2-44af-8047-652d8d048a4c req-c6ac9b64-6dfa-4a49-95bc-3a51a81a2b2d service nova] Enqueued Resource ID: afe84ec2-d66d-4a72-afc0-223b05dddb60 with Priority: HIGHEST for action security_group_rules [ 1185.360054] env[66502]: INFO networking_nsxv3.common.synchronization [req-d70c01ee-ecc2-44af-8047-652d8d048a4c req-c6ac9b64-6dfa-4a49-95bc-3a51a81a2b2d service nova] Enqueued Resource ID: afe84ec2-d66d-4a72-afc0-223b05dddb60 with Priority: HIGHEST for action security_group_members [ 1185.360188] env[66502]: INFO networking_nsxv3.common.synchronization [req-d70c01ee-ecc2-44af-8047-652d8d048a4c req-c6ac9b64-6dfa-4a49-95bc-3a51a81a2b2d service nova] Enqueued Resource ID: dc11c175-ef38-4209-ac43-24f45ffbe411 with Priority: HIGHEST for action port [ 1185.360816] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afe84ec2-d66d-4a72-afc0-223b05dddb60 with Priority: HIGHEST for action security_group_rules [ 1185.360944] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afe84ec2-d66d-4a72-afc0-223b05dddb60 with Priority: HIGHEST for action security_group_members [ 1185.361482] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dc11c175-ef38-4209-ac43-24f45ffbe411 with Priority: HIGHEST for action port [ 1185.361788] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-afe84ec2-d66d-4a72-afc0-223b05dddb60 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.362398] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-afe84ec2-d66d-4a72-afc0-223b05dddb60" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.362398] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-afe84ec2-d66d-4a72-afc0-223b05dddb60" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.362398] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-afe84ec2-d66d-4a72-afc0-223b05dddb60" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.362398] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('afe84ec2-d66d-4a72-afc0-223b05dddb60',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.363238] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-afe84ec2-d66d-4a72-afc0-223b05dddb60 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.363367] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-afe84ec2-d66d-4a72-afc0-223b05dddb60" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.363430] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-afe84ec2-d66d-4a72-afc0-223b05dddb60" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.363650] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-afe84ec2-d66d-4a72-afc0-223b05dddb60" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.363809] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.363900] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.363961] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.369089] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.369089] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.369089] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('afe84ec2-d66d-4a72-afc0-223b05dddb60',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.369657] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-dc11c175-ef38-4209-ac43-24f45ffbe411 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.369808] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dc11c175-ef38-4209-ac43-24f45ffbe411" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.369870] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dc11c175-ef38-4209-ac43-24f45ffbe411" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.370583] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dc11c175-ef38-4209-ac43-24f45ffbe411" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.370583] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dc11c175-ef38-4209-ac43-24f45ffbe411',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.748407] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3f796883-7322-4113-bfa9-5a64b4903a46',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.874032] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-afe84ec2-d66d-4a72-afc0-223b05dddb60 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.874032] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-afe84ec2-d66d-4a72-afc0-223b05dddb60" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.876528] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('afe84ec2-d66d-4a72-afc0-223b05dddb60',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.877629] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dc11c175-ef38-4209-ac43-24f45ffbe411 with status ACTIVE [ 1185.878240] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.878348] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.878427] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.878633] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.878726] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.878893] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.879480] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.879480] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.879480] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.879480] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.879637] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.879637] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.879714] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.879798] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.879860] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.879944] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dc11c175-ef38-4209-ac43-24f45ffbe411 is going to be updated. [ 1185.902637] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.902820] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.902864] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.903062] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.903200] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.903353] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dc11c175-ef38-4209-ac43-24f45ffbe411" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.252776] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.253157] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.253157] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.253286] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.253350] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.253444] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f796883-7322-4113-bfa9-5a64b4903a46 is going to be updated. [ 1186.294241] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.294481] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.294481] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.294736] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.294917] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.310143] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f796883-7322-4113-bfa9-5a64b4903a46 in Status: IN_PROGRESS for 2s [ 1186.382449] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('afe84ec2-d66d-4a72-afc0-223b05dddb60',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.586934] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da4454aa-c9b4-48df-a3af-94b687746e31 in Status: SUCCESS [ 1186.587226] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.587386] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.587667] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.587909] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.588885] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.588885] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.588885] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.588885] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.588885] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.588885] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('da4454aa-c9b4-48df-a3af-94b687746e31',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.888088] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.888088] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.888088] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.888088] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.888088] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.888088] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: afe84ec2-d66d-4a72-afc0-223b05dddb60 is going to be created. [ 1186.926188] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.926333] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.926398] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.926615] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.926774] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.952591] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: afe84ec2-d66d-4a72-afc0-223b05dddb60 in Status: UNINITIALIZED for 2s [ 1187.094340] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-da4454aa-c9b4-48df-a3af-94b687746e31 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.094340] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.094340] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.094340] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.094340] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.094340] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.094340] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.094340] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.094808] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.094808] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.094808] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-da4454aa-c9b4-48df-a3af-94b687746e31 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.094808] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.094808] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.094991] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.095112] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.095201] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.095282] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.095405] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.095469] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.095584] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.095724] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('da4454aa-c9b4-48df-a3af-94b687746e31',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1187.271033] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: bf700520-a5f6-400c-a90d-a385e198aebe in Status: SUCCESS [ 1187.271033] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf700520-a5f6-400c-a90d-a385e198aebe" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.599822] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for da4454aa-c9b4-48df-a3af-94b687746e31: rpc.has_security_group_logging(os_id): False [ 1187.618681] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.618879] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.618945] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.620104] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.620104] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.620104] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.620104] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.620104] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.620104] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.620104] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.620104] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.620679] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.620679] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.620679] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.620679] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.620803] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.620803] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.620881] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.621463] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.621463] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.621463] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da4454aa-c9b4-48df-a3af-94b687746e31 is going to be created. [ 1187.681833] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1187.682212] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1187.682430] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1187.682916] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1187.683304] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1187.697879] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da4454aa-c9b4-48df-a3af-94b687746e31 in Status: IN_PROGRESS for 2s [ 1188.320803] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f796883-7322-4113-bfa9-5a64b4903a46 in Status: SUCCESS [ 1188.321106] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.321309] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.321538] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.321734] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.321881] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.321974] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.322173] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.322255] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.322342] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.322435] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3f796883-7322-4113-bfa9-5a64b4903a46',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.814107] env[66502]: INFO networking_nsxv3.common.synchronization [req-065f87a6-f966-446d-aed4-2d9c8db441ec req-b4c5fbf3-9031-49fa-b0c0-83700f8e18aa tempest-ServerActionsTestJSON-2133613622 tempest-ServerActionsTestJSON-2133613622-project-member] Enqueued Resource ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 with Priority: HIGHEST for action security_group_members [ 1188.814505] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 with Priority: HIGHEST for action security_group_members [ 1188.814940] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.814940] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.815123] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.815554] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.815554] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.815554] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.815760] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.815760] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.815864] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.816048] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ab1d50c-f5a6-4aaf-829b-d0cfdf164722',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.824877] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f796883-7322-4113-bfa9-5a64b4903a46 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.825098] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.825098] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.825790] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.825790] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.825790] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.826088] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.826088] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.826088] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.826195] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.826296] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f796883-7322-4113-bfa9-5a64b4903a46 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.826385] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.826444] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.826583] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.826718] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.826808] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.826867] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.827011] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.827090] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.827523] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.827523] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3f796883-7322-4113-bfa9-5a64b4903a46',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.967180] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: afe84ec2-d66d-4a72-afc0-223b05dddb60 in Status: SUCCESS [ 1188.967180] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-afe84ec2-d66d-4a72-afc0-223b05dddb60" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.967386] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-afe84ec2-d66d-4a72-afc0-223b05dddb60" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.967444] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-afe84ec2-d66d-4a72-afc0-223b05dddb60" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.967676] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.967800] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.967847] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.967975] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.968088] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.968213] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-afe84ec2-d66d-4a72-afc0-223b05dddb60" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.968254] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('afe84ec2-d66d-4a72-afc0-223b05dddb60',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.317758] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.317941] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.317997] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.318244] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.318387] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.318586] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.318690] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.318751] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.318908] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.318982] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.319081] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 is going to be updated. [ 1189.330156] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3f796883-7322-4113-bfa9-5a64b4903a46: rpc.has_security_group_logging(os_id): False [ 1189.350227] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.351138] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.351138] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.351138] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.351138] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.351504] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.351677] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.351783] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.352060] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.352202] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.352588] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.352762] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.352867] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.353135] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.353275] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.353616] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.353746] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.353852] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.354098] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.354230] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.354367] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f796883-7322-4113-bfa9-5a64b4903a46 is going to be updated. [ 1189.356584] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.356584] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.356725] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.356761] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.357308] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.367759] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 in Status: IN_PROGRESS for 2s [ 1189.430663] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.430834] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.430886] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.431134] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.431753] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.449516] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f796883-7322-4113-bfa9-5a64b4903a46 in Status: IN_PROGRESS for 2s [ 1189.471593] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-afe84ec2-d66d-4a72-afc0-223b05dddb60 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.471802] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-afe84ec2-d66d-4a72-afc0-223b05dddb60" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.471854] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-afe84ec2-d66d-4a72-afc0-223b05dddb60" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.472090] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-afe84ec2-d66d-4a72-afc0-223b05dddb60" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.472794] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.472794] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.472794] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.472794] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.472794] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.472794] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-afe84ec2-d66d-4a72-afc0-223b05dddb60" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.473197] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-afe84ec2-d66d-4a72-afc0-223b05dddb60 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.473197] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-afe84ec2-d66d-4a72-afc0-223b05dddb60" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.473197] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-afe84ec2-d66d-4a72-afc0-223b05dddb60" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.473197] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-afe84ec2-d66d-4a72-afc0-223b05dddb60" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.473381] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.473381] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.473381] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.473588] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.473588] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.473646] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-afe84ec2-d66d-4a72-afc0-223b05dddb60" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.473737] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('afe84ec2-d66d-4a72-afc0-223b05dddb60',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.702825] env[66502]: INFO networking_nsxv3.common.synchronization [None req-a085e3ce-7527-4ead-b86a-d5e113b0f021 tempest-AttachInterfacesTestJSON-1531294335 tempest-AttachInterfacesTestJSON-1531294335-project-member] Enqueued Resource ID: 3f796883-7322-4113-bfa9-5a64b4903a46 with Priority: HIGHEST for action security_group_members [ 1189.703449] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f796883-7322-4113-bfa9-5a64b4903a46 with Priority: HIGHEST for action security_group_members [ 1189.704407] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f796883-7322-4113-bfa9-5a64b4903a46 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.704663] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.704819] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.705456] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.705720] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.706365] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.706619] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.706913] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.707117] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.707293] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f796883-7322-4113-bfa9-5a64b4903a46',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.719266] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da4454aa-c9b4-48df-a3af-94b687746e31 in Status: SUCCESS [ 1189.719266] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.976278] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for afe84ec2-d66d-4a72-afc0-223b05dddb60: rpc.has_security_group_logging(os_id): False [ 1189.995765] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.995929] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.996010] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.996388] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.996501] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.996736] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.996844] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.996902] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.997073] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.997148] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.997336] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.997424] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.997486] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.997628] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.997700] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.997894] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.997985] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.998066] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.998209] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.998281] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.998367] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: afe84ec2-d66d-4a72-afc0-223b05dddb60 is going to be created. [ 1190.073424] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.073650] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.073650] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.073888] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.074088] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.086397] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: afe84ec2-d66d-4a72-afc0-223b05dddb60 in Status: IN_PROGRESS for 2s [ 1190.209579] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3f796883-7322-4113-bfa9-5a64b4903a46',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.711725] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3f796883-7322-4113-bfa9-5a64b4903a46',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.216472] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.216472] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.216472] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.216472] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.216472] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.216472] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f796883-7322-4113-bfa9-5a64b4903a46 is going to be updated. [ 1191.251076] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.251076] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.251076] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.251076] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.251076] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.262551] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f796883-7322-4113-bfa9-5a64b4903a46 in Status: IN_PROGRESS for 2s [ 1191.378345] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 in Status: SUCCESS [ 1191.378575] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 deletion is rescheduled due to dependency. [ 1191.378699] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.464322] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f796883-7322-4113-bfa9-5a64b4903a46 in Status: SUCCESS [ 1191.464560] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.567470] env[66502]: INFO networking_nsxv3.common.synchronization [req-96c36b96-123c-4508-a5a6-f7cef1456c60 req-2725da7a-f993-4fde-90e4-81133b2e2d78 tempest-ListImageFiltersTestJSON-1337315773 tempest-ListImageFiltersTestJSON-1337315773-project-member] Enqueued Resource ID: 4fcd5f21-1906-475c-9571-24c419ac05d8 with Priority: HIGHEST for action security_group_members [ 1191.567470] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fcd5f21-1906-475c-9571-24c419ac05d8 with Priority: HIGHEST for action security_group_members [ 1191.567470] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fcd5f21-1906-475c-9571-24c419ac05d8 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.567470] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.567470] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.567470] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.567470] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.567470] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.567470] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.567470] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.567470] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.568187] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fcd5f21-1906-475c-9571-24c419ac05d8',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.966341] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-584 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.966729] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-584" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.966729] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-584" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.966923] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-584" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.967198] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.967357] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.967474] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.967697] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.967889] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.968183] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1191.968312] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1191.968424] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1191.968534] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1191.968671] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1191.968818] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1191.968983] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1191.994868] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1191.995064] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1191.995181] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1191.995369] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-584" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.995710] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-c156e47e-0878-4024-9b5c-f1dc21935604 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.995888] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-c156e47e-0878-4024-9b5c-f1dc21935604" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.996017] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-c156e47e-0878-4024-9b5c-f1dc21935604" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.996385] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-c156e47e-0878-4024-9b5c-f1dc21935604" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.996526] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c156e47e-0878-4024-9b5c-f1dc21935604',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.073847] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4fcd5f21-1906-475c-9571-24c419ac05d8',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.102051] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: afe84ec2-d66d-4a72-afc0-223b05dddb60 in Status: SUCCESS [ 1192.102051] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-afe84ec2-d66d-4a72-afc0-223b05dddb60" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.499456] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.499681] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.499800] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.500131] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.500283] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.500439] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port c156e47e-0878-4024-9b5c-f1dc21935604 not found, creating... [ 1192.500853] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.501089] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.501231] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.501468] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.501673] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.502008] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.502573] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.502573] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.502573] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.502722] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.503024] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: c156e47e-0878-4024-9b5c-f1dc21935604 is going to be created. [ 1192.525099] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.525350] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.525480] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.525758] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.525987] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.526228] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-c156e47e-0878-4024-9b5c-f1dc21935604" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.576183] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4fcd5f21-1906-475c-9571-24c419ac05d8',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.078747] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.079125] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.079125] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.084020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.084020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.084020] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fcd5f21-1906-475c-9571-24c419ac05d8 is going to be updated. [ 1193.113105] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.113446] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.113446] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.113446] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.113582] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.123339] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fcd5f21-1906-475c-9571-24c419ac05d8 in Status: IN_PROGRESS for 2s [ 1193.246719] env[66502]: INFO networking_nsxv3.common.synchronization [req-d7f94a3d-221c-4502-a4a5-857125609474 req-6aabdb99-61a9-4912-95d2-0e44f728701f service nova] Enqueued Resource ID: 3f796883-7322-4113-bfa9-5a64b4903a46 with Priority: HIGHEST for action security_group_rules [ 1193.246907] env[66502]: INFO networking_nsxv3.common.synchronization [req-d7f94a3d-221c-4502-a4a5-857125609474 req-6aabdb99-61a9-4912-95d2-0e44f728701f service nova] Enqueued Resource ID: 3f796883-7322-4113-bfa9-5a64b4903a46 with Priority: HIGHEST for action security_group_members [ 1193.247081] env[66502]: INFO networking_nsxv3.common.synchronization [req-d7f94a3d-221c-4502-a4a5-857125609474 req-6aabdb99-61a9-4912-95d2-0e44f728701f service nova] Enqueued Resource ID: c156e47e-0878-4024-9b5c-f1dc21935604 with Priority: HIGHEST for action port [ 1193.247690] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f796883-7322-4113-bfa9-5a64b4903a46 with Priority: HIGHEST for action security_group_rules [ 1193.247823] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f796883-7322-4113-bfa9-5a64b4903a46 with Priority: HIGHEST for action security_group_members [ 1193.248009] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c156e47e-0878-4024-9b5c-f1dc21935604 with Priority: HIGHEST for action port [ 1193.248209] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f796883-7322-4113-bfa9-5a64b4903a46 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.248333] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.248400] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.248675] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.248716] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f796883-7322-4113-bfa9-5a64b4903a46',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.251353] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f796883-7322-4113-bfa9-5a64b4903a46 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.251353] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.251353] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-c156e47e-0878-4024-9b5c-f1dc21935604 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.251353] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c156e47e-0878-4024-9b5c-f1dc21935604" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.251353] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c156e47e-0878-4024-9b5c-f1dc21935604" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.251353] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c156e47e-0878-4024-9b5c-f1dc21935604" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.251787] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c156e47e-0878-4024-9b5c-f1dc21935604',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.273071] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f796883-7322-4113-bfa9-5a64b4903a46 in Status: SUCCESS [ 1193.274024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.274024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.274024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.274024] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.274024] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.274281] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.274391] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.274496] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.274600] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f796883-7322-4113-bfa9-5a64b4903a46',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.751189] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f796883-7322-4113-bfa9-5a64b4903a46 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.751363] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.753744] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c156e47e-0878-4024-9b5c-f1dc21935604 with status ACTIVE [ 1193.753951] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.754095] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.754166] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.754400] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.754504] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.754911] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.755144] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.755265] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.755456] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.755539] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.755779] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.755924] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.755990] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.756152] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.756280] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.756376] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c156e47e-0878-4024-9b5c-f1dc21935604 is going to be updated. [ 1193.759451] env[66502]: INFO networking_nsxv3.common.synchronization [req-b344e81f-2496-4eb7-b4eb-51da14e6d561 req-b27b782e-ff97-4bbe-aadd-e356de3e7b3e tempest-ServersNegativeTestMultiTenantJSON-35168583 tempest-ServersNegativeTestMultiTenantJSON-35168583-project-member] Enqueued Resource ID: 62257f18-fec2-4d84-abfc-4bb2cbec54bc with Priority: HIGHEST for action security_group_members [ 1193.760131] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62257f18-fec2-4d84-abfc-4bb2cbec54bc with Priority: HIGHEST for action security_group_members [ 1193.760715] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-62257f18-fec2-4d84-abfc-4bb2cbec54bc taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.760826] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62257f18-fec2-4d84-abfc-4bb2cbec54bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.760893] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62257f18-fec2-4d84-abfc-4bb2cbec54bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.761179] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62257f18-fec2-4d84-abfc-4bb2cbec54bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.761331] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.761428] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.761489] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.761804] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.761904] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.762012] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62257f18-fec2-4d84-abfc-4bb2cbec54bc',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.776817] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3f796883-7322-4113-bfa9-5a64b4903a46',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1193.779017] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.779142] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.779885] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.779885] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.779885] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.779885] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c156e47e-0878-4024-9b5c-f1dc21935604" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.107606] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-919 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.107919] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-919" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.107963] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-919" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.108450] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-919" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.108751] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.108931] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.109067] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.109324] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.109463] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.109701] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1194.109818] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1194.109927] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1194.110050] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1194.110166] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1194.110271] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1194.110400] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1194.130492] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1194.130659] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1194.130826] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1194.131016] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-919" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.131394] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-4d4670b2-3838-4bc7-a8c9-f4c0c1a9194a taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.131574] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-4d4670b2-3838-4bc7-a8c9-f4c0c1a9194a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.131704] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-4d4670b2-3838-4bc7-a8c9-f4c0c1a9194a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.132061] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-4d4670b2-3838-4bc7-a8c9-f4c0c1a9194a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.132221] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d4670b2-3838-4bc7-a8c9-f4c0c1a9194a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.264843] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.265191] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.265191] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.265380] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.265429] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.265855] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.265855] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.265855] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.267104] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.267104] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.267104] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62257f18-fec2-4d84-abfc-4bb2cbec54bc already deleted. [ 1194.267104] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62257f18-fec2-4d84-abfc-4bb2cbec54bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.279593] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3f796883-7322-4113-bfa9-5a64b4903a46',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.635340] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.635910] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.636176] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.638030] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.638030] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.638030] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 4d4670b2-3838-4bc7-a8c9-f4c0c1a9194a not found, creating... [ 1194.638030] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.638030] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.638030] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.638030] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.638030] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.639351] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.642278] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.642278] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.642278] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.642278] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.642278] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 4d4670b2-3838-4bc7-a8c9-f4c0c1a9194a is going to be created. [ 1194.668564] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.668564] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.668564] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.668564] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.668564] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.668564] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-4d4670b2-3838-4bc7-a8c9-f4c0c1a9194a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.781914] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.782216] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.782429] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.782493] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.782578] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.782686] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f796883-7322-4113-bfa9-5a64b4903a46 is going to be updated. [ 1194.918125] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1194.918125] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1194.918125] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1194.918125] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1194.918125] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1194.928398] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f796883-7322-4113-bfa9-5a64b4903a46 in Status: IN_PROGRESS for 2s [ 1195.139316] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fcd5f21-1906-475c-9571-24c419ac05d8 in Status: SUCCESS [ 1195.139677] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.416778] env[66502]: INFO networking_nsxv3.common.synchronization [req-b344e81f-2496-4eb7-b4eb-51da14e6d561 req-73d27b76-38cc-4c8e-8f1c-38a26b1d7df1 service nova] Enqueued Resource ID: 62257f18-fec2-4d84-abfc-4bb2cbec54bc with Priority: HIGHEST for action security_group_rules [ 1195.416778] env[66502]: INFO networking_nsxv3.common.synchronization [req-b344e81f-2496-4eb7-b4eb-51da14e6d561 req-73d27b76-38cc-4c8e-8f1c-38a26b1d7df1 service nova] Enqueued Resource ID: 62257f18-fec2-4d84-abfc-4bb2cbec54bc with Priority: HIGHEST for action security_group_members [ 1195.416778] env[66502]: INFO networking_nsxv3.common.synchronization [req-b344e81f-2496-4eb7-b4eb-51da14e6d561 req-73d27b76-38cc-4c8e-8f1c-38a26b1d7df1 service nova] Enqueued Resource ID: 4d4670b2-3838-4bc7-a8c9-f4c0c1a9194a with Priority: HIGHEST for action port [ 1195.416778] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62257f18-fec2-4d84-abfc-4bb2cbec54bc with Priority: HIGHEST for action security_group_rules [ 1195.416778] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62257f18-fec2-4d84-abfc-4bb2cbec54bc with Priority: HIGHEST for action security_group_members [ 1195.416778] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4d4670b2-3838-4bc7-a8c9-f4c0c1a9194a with Priority: HIGHEST for action port [ 1195.416778] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-62257f18-fec2-4d84-abfc-4bb2cbec54bc taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.416778] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-62257f18-fec2-4d84-abfc-4bb2cbec54bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.416778] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-62257f18-fec2-4d84-abfc-4bb2cbec54bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.417682] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-62257f18-fec2-4d84-abfc-4bb2cbec54bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.417852] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('62257f18-fec2-4d84-abfc-4bb2cbec54bc',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.419052] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-62257f18-fec2-4d84-abfc-4bb2cbec54bc taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.419052] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62257f18-fec2-4d84-abfc-4bb2cbec54bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.419052] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62257f18-fec2-4d84-abfc-4bb2cbec54bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.419214] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62257f18-fec2-4d84-abfc-4bb2cbec54bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.419253] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.419353] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.419417] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.419568] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.419653] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.419743] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62257f18-fec2-4d84-abfc-4bb2cbec54bc',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.420529] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-4d4670b2-3838-4bc7-a8c9-f4c0c1a9194a taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.420657] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4d4670b2-3838-4bc7-a8c9-f4c0c1a9194a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.420722] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4d4670b2-3838-4bc7-a8c9-f4c0c1a9194a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.420872] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4d4670b2-3838-4bc7-a8c9-f4c0c1a9194a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.420945] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4d4670b2-3838-4bc7-a8c9-f4c0c1a9194a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.912170] env[66502]: INFO networking_nsxv3.common.synchronization [req-93e2511c-5a20-485d-af88-90f537d718be req-f793901f-c691-4450-b129-a6a287de1246 tempest-AttachVolumeShelveTestJSON-163785099 tempest-AttachVolumeShelveTestJSON-163785099-project-member] Enqueued Resource ID: 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 with Priority: HIGHEST for action security_group_members [ 1195.912170] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 with Priority: HIGHEST for action security_group_members [ 1195.912170] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.912170] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.912170] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.912899] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.913252] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.913506] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.913737] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.914062] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.915033] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.915033] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('14691ab9-6ef7-4499-a5c8-0c1a0b5a8191',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.925348] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('62257f18-fec2-4d84-abfc-4bb2cbec54bc',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.925348] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-62257f18-fec2-4d84-abfc-4bb2cbec54bc taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.925348] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62257f18-fec2-4d84-abfc-4bb2cbec54bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.925348] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4d4670b2-3838-4bc7-a8c9-f4c0c1a9194a with status ACTIVE [ 1195.925348] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.925348] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.925348] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.925348] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.925348] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.927280] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.927280] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.927280] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.927280] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.927280] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.927280] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.927280] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.927280] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.927280] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.927280] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.927280] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4d4670b2-3838-4bc7-a8c9-f4c0c1a9194a is going to be updated. [ 1195.951360] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.951502] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.951610] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.951797] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.951932] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.952106] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4d4670b2-3838-4bc7-a8c9-f4c0c1a9194a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.416905] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.417299] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.417299] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.417800] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.417800] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.417800] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.417800] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.418102] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.418102] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.418102] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.418213] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 is going to be updated. [ 1196.429520] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('62257f18-fec2-4d84-abfc-4bb2cbec54bc',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.451343] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.451442] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.451503] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.451744] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.451887] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.461318] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 in Status: IN_PROGRESS for 2s [ 1196.932011] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.932171] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.932291] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.932463] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.932546] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.932644] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62257f18-fec2-4d84-abfc-4bb2cbec54bc is going to be created. [ 1196.941270] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f796883-7322-4113-bfa9-5a64b4903a46 in Status: SUCCESS [ 1196.941474] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.941668] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.941885] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.942086] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.942198] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.942267] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.942410] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.942486] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.942571] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.942661] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3f796883-7322-4113-bfa9-5a64b4903a46',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1196.971337] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1196.971482] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1196.971668] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1196.971859] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1196.972043] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1196.984036] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62257f18-fec2-4d84-abfc-4bb2cbec54bc in Status: UNINITIALIZED for 2s [ 1197.448866] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f796883-7322-4113-bfa9-5a64b4903a46 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.448866] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.448866] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.448866] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.448866] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.448866] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.448866] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.448866] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.448866] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.448866] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.448866] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f796883-7322-4113-bfa9-5a64b4903a46 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.448866] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.448866] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.448866] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.448866] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.448866] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.449842] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.449842] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.449842] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.449842] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.449842] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3f796883-7322-4113-bfa9-5a64b4903a46',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.951556] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3f796883-7322-4113-bfa9-5a64b4903a46: rpc.has_security_group_logging(os_id): False [ 1197.972261] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.972412] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.972475] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.972885] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.972885] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.973010] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.973143] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.973260] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.973390] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.973488] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.973711] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.973883] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.973931] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.974059] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.974142] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.974325] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.974419] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.974480] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.974619] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.974695] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.974778] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f796883-7322-4113-bfa9-5a64b4903a46 is going to be updated. [ 1198.015123] env[66502]: INFO networking_nsxv3.common.synchronization [req-c5a03363-529b-432b-aed9-6c3828c43f73 req-7bcb46b8-fa0e-4e87-934d-06c681804159 tempest-ListImageFiltersTestJSON-1337315773 tempest-ListImageFiltersTestJSON-1337315773-project-member] Enqueued Resource ID: 4fcd5f21-1906-475c-9571-24c419ac05d8 with Priority: HIGHEST for action security_group_members [ 1198.016097] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4fcd5f21-1906-475c-9571-24c419ac05d8 with Priority: HIGHEST for action security_group_members [ 1198.016097] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-4fcd5f21-1906-475c-9571-24c419ac05d8 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.016204] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.016252] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.016651] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.016651] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.016782] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.016856] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.017040] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.017157] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.017271] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4fcd5f21-1906-475c-9571-24c419ac05d8',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1198.044882] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.045133] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.045296] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.045570] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.046196] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.065141] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f796883-7322-4113-bfa9-5a64b4903a46 in Status: IN_PROGRESS for 2s [ 1198.473453] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 in Status: SUCCESS [ 1198.473829] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 deletion is rescheduled due to dependency. [ 1198.473938] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.520026] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.520174] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.520218] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.520584] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.520584] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.521998] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.521998] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.521998] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.521998] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.521998] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.521998] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fcd5f21-1906-475c-9571-24c419ac05d8 is going to be updated. [ 1198.549369] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.549369] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.549561] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.549648] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.549788] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.560263] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fcd5f21-1906-475c-9571-24c419ac05d8 in Status: IN_PROGRESS for 2s [ 1198.995319] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62257f18-fec2-4d84-abfc-4bb2cbec54bc in Status: SUCCESS [ 1198.995715] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62257f18-fec2-4d84-abfc-4bb2cbec54bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.995937] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62257f18-fec2-4d84-abfc-4bb2cbec54bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.996285] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62257f18-fec2-4d84-abfc-4bb2cbec54bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.996599] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.996795] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.996906] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.997150] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.997737] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.997737] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62257f18-fec2-4d84-abfc-4bb2cbec54bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.997737] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('62257f18-fec2-4d84-abfc-4bb2cbec54bc',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.368685] env[66502]: INFO networking_nsxv3.common.synchronization [req-e48fc2f4-0948-46a5-827b-c1c37963f45d req-0d72e0ce-6b57-43dd-adf8-fd9a2ff26f74 tempest-ServerActionsTestJSON-2133613622 tempest-ServerActionsTestJSON-2133613622-project-member] Enqueued Resource ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 with Priority: HIGHEST for action security_group_members [ 1199.369294] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 with Priority: HIGHEST for action security_group_members [ 1199.369608] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.369745] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.369846] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.370192] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.370460] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.370460] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.370699] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.370784] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.370858] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.370954] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ab1d50c-f5a6-4aaf-829b-d0cfdf164722',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.499745] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-62257f18-fec2-4d84-abfc-4bb2cbec54bc taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.500124] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62257f18-fec2-4d84-abfc-4bb2cbec54bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.500124] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62257f18-fec2-4d84-abfc-4bb2cbec54bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.500195] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62257f18-fec2-4d84-abfc-4bb2cbec54bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.500338] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.500436] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.500500] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.500678] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.500762] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.501119] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62257f18-fec2-4d84-abfc-4bb2cbec54bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.501119] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-62257f18-fec2-4d84-abfc-4bb2cbec54bc taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.501119] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62257f18-fec2-4d84-abfc-4bb2cbec54bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.501274] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62257f18-fec2-4d84-abfc-4bb2cbec54bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.501274] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62257f18-fec2-4d84-abfc-4bb2cbec54bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.501417] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.501505] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.501564] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.501715] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.502020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.502114] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62257f18-fec2-4d84-abfc-4bb2cbec54bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.502205] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('62257f18-fec2-4d84-abfc-4bb2cbec54bc',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.666155] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-834 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.666410] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-834" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.666541] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-834" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.666916] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-834" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.667423] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.667646] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.667806] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.668487] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.668671] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.668943] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1199.669135] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1199.669281] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1199.669421] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1199.669558] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1199.669827] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1199.670023] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1199.691342] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1199.691590] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1199.691925] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1199.692209] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-834" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.692656] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-538ad8cd-5465-401b-88af-08896cfe7117 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.692921] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-538ad8cd-5465-401b-88af-08896cfe7117" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.693124] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-538ad8cd-5465-401b-88af-08896cfe7117" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.693592] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-538ad8cd-5465-401b-88af-08896cfe7117" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.693804] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('538ad8cd-5465-401b-88af-08896cfe7117',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1199.873418] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.873807] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.873807] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.874243] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.874401] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.876106] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.876106] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.876106] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.876106] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.876106] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.876106] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 is going to be updated. [ 1199.905995] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1199.906319] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1199.906319] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1199.906464] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1199.906630] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1199.919597] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 in Status: IN_PROGRESS for 2s [ 1200.004477] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 62257f18-fec2-4d84-abfc-4bb2cbec54bc: rpc.has_security_group_logging(os_id): False [ 1200.008955] env[66502]: INFO networking_nsxv3.common.synchronization [req-63d7f522-199f-42ee-863e-e94ce3255f06 req-43333a7f-cccf-4b54-99f4-fd1781cadcc5 tempest-ServerTagsTestJSON-586476178 tempest-ServerTagsTestJSON-586476178-project-member] Enqueued Resource ID: afe84ec2-d66d-4a72-afc0-223b05dddb60 with Priority: HIGHEST for action security_group_members [ 1200.010028] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afe84ec2-d66d-4a72-afc0-223b05dddb60 with Priority: HIGHEST for action security_group_members [ 1200.010444] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-afe84ec2-d66d-4a72-afc0-223b05dddb60 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.010586] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-afe84ec2-d66d-4a72-afc0-223b05dddb60" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.010721] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-afe84ec2-d66d-4a72-afc0-223b05dddb60" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.010935] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-afe84ec2-d66d-4a72-afc0-223b05dddb60" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.011110] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.011213] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.011274] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.011423] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.011512] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.011608] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('afe84ec2-d66d-4a72-afc0-223b05dddb60',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.029915] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.030059] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.030145] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.030367] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.030462] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.030738] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.030849] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.030933] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.031148] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.031233] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.031413] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.031524] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.031589] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.031747] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.031810] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.031944] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.032126] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.032192] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.032358] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.032434] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.032530] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 62257f18-fec2-4d84-abfc-4bb2cbec54bc is going to be created. [ 1200.083389] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f796883-7322-4113-bfa9-5a64b4903a46 in Status: SUCCESS [ 1200.083606] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.109334] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.109576] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.109576] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.109903] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.110169] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.124840] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 62257f18-fec2-4d84-abfc-4bb2cbec54bc in Status: IN_PROGRESS for 2s [ 1200.196985] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.197239] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.197366] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.197658] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.197809] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.197964] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port 538ad8cd-5465-401b-88af-08896cfe7117 not found, creating... [ 1200.198244] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.198402] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.198519] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.198739] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.198873] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.199169] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.199325] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.199525] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.199644] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.199773] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.200018] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: 538ad8cd-5465-401b-88af-08896cfe7117 is going to be created. [ 1200.227933] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.228236] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.228378] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.228658] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.228980] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.229155] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-538ad8cd-5465-401b-88af-08896cfe7117" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.514036] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.514036] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.514036] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.514493] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.514493] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.514493] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.514616] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.514616] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.514738] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.514816] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.514901] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: afe84ec2-d66d-4a72-afc0-223b05dddb60 is going to be updated. [ 1200.542186] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.542450] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.542450] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.542636] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.542773] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.555477] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: afe84ec2-d66d-4a72-afc0-223b05dddb60 in Status: IN_PROGRESS for 2s [ 1200.570459] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4fcd5f21-1906-475c-9571-24c419ac05d8 in Status: SUCCESS [ 1200.570459] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4fcd5f21-1906-475c-9571-24c419ac05d8 deletion is rescheduled due to dependency. [ 1200.570459] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4fcd5f21-1906-475c-9571-24c419ac05d8" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.920445] env[66502]: INFO networking_nsxv3.common.synchronization [req-e48fc2f4-0948-46a5-827b-c1c37963f45d req-bfd122bd-2ac4-466b-9f6a-4bcce5b77e13 service nova] Enqueued Resource ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 with Priority: HIGHEST for action security_group_rules [ 1200.920609] env[66502]: INFO networking_nsxv3.common.synchronization [req-e48fc2f4-0948-46a5-827b-c1c37963f45d req-bfd122bd-2ac4-466b-9f6a-4bcce5b77e13 service nova] Enqueued Resource ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 with Priority: HIGHEST for action security_group_members [ 1200.920657] env[66502]: INFO networking_nsxv3.common.synchronization [req-e48fc2f4-0948-46a5-827b-c1c37963f45d req-bfd122bd-2ac4-466b-9f6a-4bcce5b77e13 service nova] Enqueued Resource ID: 538ad8cd-5465-401b-88af-08896cfe7117 with Priority: HIGHEST for action port [ 1200.921490] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 with Priority: HIGHEST for action security_group_rules [ 1200.921490] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 with Priority: HIGHEST for action security_group_members [ 1200.921490] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 538ad8cd-5465-401b-88af-08896cfe7117 with Priority: HIGHEST for action port [ 1200.921730] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.921875] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.921938] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.922162] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.922243] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ab1d50c-f5a6-4aaf-829b-d0cfdf164722',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1200.923162] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.923301] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.923566] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-538ad8cd-5465-401b-88af-08896cfe7117 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1200.923690] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-538ad8cd-5465-401b-88af-08896cfe7117" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1200.923690] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-538ad8cd-5465-401b-88af-08896cfe7117" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1200.923949] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-538ad8cd-5465-401b-88af-08896cfe7117" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1200.924043] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('538ad8cd-5465-401b-88af-08896cfe7117',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.426127] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.426273] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.426707] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 538ad8cd-5465-401b-88af-08896cfe7117 with status ACTIVE [ 1201.426707] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.426707] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.426883] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.426971] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.427118] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.427231] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.427411] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.427411] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.427524] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.427653] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.427777] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.427903] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.427981] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.428163] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.428163] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.428307] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 538ad8cd-5465-401b-88af-08896cfe7117 is going to be updated. [ 1201.450955] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.451117] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.451191] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.451407] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.451533] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.451692] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-538ad8cd-5465-401b-88af-08896cfe7117" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.895077] env[66502]: INFO networking_nsxv3.common.synchronization [None req-152f98b9-0b26-42e9-a016-aff0afd66284 tempest-AttachVolumeShelveTestJSON-163785099 tempest-AttachVolumeShelveTestJSON-163785099-project-member] Enqueued Resource ID: a5eea73e-9fb6-401e-a5a6-756487d3d58d with Priority: HIGHEST for action security_group_rules [ 1201.895632] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5eea73e-9fb6-401e-a5a6-756487d3d58d with Priority: HIGHEST for action security_group_rules [ 1201.895944] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5eea73e-9fb6-401e-a5a6-756487d3d58d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.896135] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5eea73e-9fb6-401e-a5a6-756487d3d58d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.896206] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5eea73e-9fb6-401e-a5a6-756487d3d58d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.896467] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5eea73e-9fb6-401e-a5a6-756487d3d58d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.896547] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5eea73e-9fb6-401e-a5a6-756487d3d58d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.929692] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 in Status: SUCCESS [ 1201.929885] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 deletion is rescheduled due to dependency. [ 1201.929984] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.930227] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.930507] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.930730] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.930939] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1201.931079] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1201.931319] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1201.931537] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1201.931595] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ab1d50c-f5a6-4aaf-829b-d0cfdf164722',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1201.990102] env[66502]: INFO networking_nsxv3.common.synchronization [None req-001f956f-8db5-4c5a-8e82-8a8dcfbab41e tempest-AttachVolumeShelveTestJSON-163785099 tempest-AttachVolumeShelveTestJSON-163785099-project-member] Enqueued Resource ID: a5eea73e-9fb6-401e-a5a6-756487d3d58d with Priority: HIGHEST for action security_group_rules [ 1201.991015] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5eea73e-9fb6-401e-a5a6-756487d3d58d with Priority: HIGHEST for action security_group_rules [ 1201.991358] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5eea73e-9fb6-401e-a5a6-756487d3d58d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1201.991495] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5eea73e-9fb6-401e-a5a6-756487d3d58d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.140604] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 62257f18-fec2-4d84-abfc-4bb2cbec54bc in Status: SUCCESS [ 1202.140604] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-62257f18-fec2-4d84-abfc-4bb2cbec54bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.418293] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.418293] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.418493] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.418712] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.418712] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.418791] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5eea73e-9fb6-401e-a5a6-756487d3d58d already deleted. [ 1202.418839] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5eea73e-9fb6-401e-a5a6-756487d3d58d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.419017] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5eea73e-9fb6-401e-a5a6-756487d3d58d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.419158] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5eea73e-9fb6-401e-a5a6-756487d3d58d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.419245] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5eea73e-9fb6-401e-a5a6-756487d3d58d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.434313] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8ab1d50c-f5a6-4aaf-829b-d0cfdf164722',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.566368] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: afe84ec2-d66d-4a72-afc0-223b05dddb60 in Status: SUCCESS [ 1202.567094] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: afe84ec2-d66d-4a72-afc0-223b05dddb60 deletion is rescheduled due to dependency. [ 1202.567199] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-afe84ec2-d66d-4a72-afc0-223b05dddb60" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.937101] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8ab1d50c-f5a6-4aaf-829b-d0cfdf164722',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1202.944033] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.944224] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.944224] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.944371] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.944463] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.944558] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5eea73e-9fb6-401e-a5a6-756487d3d58d already deleted. [ 1202.944639] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5eea73e-9fb6-401e-a5a6-756487d3d58d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.441935] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.442243] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.442322] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.442533] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.442623] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.442753] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 is going to be updated. [ 1203.479500] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.479700] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.479700] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.480453] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.480453] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.491292] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 in Status: IN_PROGRESS for 2s [ 1204.681591] env[66502]: INFO networking_nsxv3.common.synchronization [req-da4eee90-ec47-4dbe-ad30-adc42f815948 req-2a346c99-044c-45f5-a8ca-e56c359862b4 tempest-ServerActionsTestOtherB-501490242 tempest-ServerActionsTestOtherB-501490242-project-member] Enqueued Resource ID: 670eb61a-b688-45b2-9400-64232c7b8af0 with Priority: HIGHEST for action security_group_members [ 1204.682252] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 670eb61a-b688-45b2-9400-64232c7b8af0 with Priority: HIGHEST for action security_group_members [ 1204.682587] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-670eb61a-b688-45b2-9400-64232c7b8af0 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.682712] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.682788] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.682994] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.684351] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.684516] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.684618] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.684843] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.684962] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.685114] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('670eb61a-b688-45b2-9400-64232c7b8af0',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.188335] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.188559] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.188661] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.188945] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.189085] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.189317] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.189422] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.189491] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.189685] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.189774] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.189922] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 670eb61a-b688-45b2-9400-64232c7b8af0 is going to be updated. [ 1205.221023] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.221023] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.221023] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.221023] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.221023] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.230212] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 670eb61a-b688-45b2-9400-64232c7b8af0 in Status: IN_PROGRESS for 2s [ 1205.501059] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 in Status: SUCCESS [ 1205.501308] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.501516] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.501803] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.502022] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.502186] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.502186] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.502352] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.502467] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.502585] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.502698] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8ab1d50c-f5a6-4aaf-829b-d0cfdf164722',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.580082] env[66502]: INFO networking_nsxv3.common.synchronization [req-ee370314-52e0-4021-a700-e7d6611a9eb6 req-55ae9085-c380-4f53-8b41-d388f5f6132d tempest-AttachInterfacesTestJSON-1531294335 tempest-AttachInterfacesTestJSON-1531294335-project-member] Enqueued Resource ID: 3f796883-7322-4113-bfa9-5a64b4903a46 with Priority: HIGHEST for action security_group_members [ 1205.580516] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f796883-7322-4113-bfa9-5a64b4903a46 with Priority: HIGHEST for action security_group_members [ 1205.580900] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f796883-7322-4113-bfa9-5a64b4903a46 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.581061] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.581127] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.581392] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.581560] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.581676] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.581756] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.582039] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.582124] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.583263] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f796883-7322-4113-bfa9-5a64b4903a46',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.005892] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8ab1d50c-f5a6-4aaf-829b-d0cfdf164722',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.084905] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3f796883-7322-4113-bfa9-5a64b4903a46',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.439765] env[66502]: INFO networking_nsxv3.common.synchronization [req-3090889e-fddf-4f61-ac27-2c998a5480ac req-4f252e44-4959-463e-82aa-d5e0b11e7130 tempest-AttachVolumeTestJSON-1757376105 tempest-AttachVolumeTestJSON-1757376105-project-member] Enqueued Resource ID: c04d1b14-a58f-4eee-b805-5b75e4c0afc4 with Priority: HIGHEST for action security_group_members [ 1206.440442] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c04d1b14-a58f-4eee-b805-5b75e4c0afc4 with Priority: HIGHEST for action security_group_members [ 1206.440893] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-c04d1b14-a58f-4eee-b805-5b75e4c0afc4 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.441134] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c04d1b14-a58f-4eee-b805-5b75e4c0afc4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.441391] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c04d1b14-a58f-4eee-b805-5b75e4c0afc4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.441515] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c04d1b14-a58f-4eee-b805-5b75e4c0afc4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.441707] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.441834] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.441925] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.442143] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.442900] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.442900] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c04d1b14-a58f-4eee-b805-5b75e4c0afc4',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.509254] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722: rpc.has_security_group_logging(os_id): False [ 1206.529737] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.529871] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.529964] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.530182] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.530428] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.530497] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.530593] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.530652] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.530900] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.530972] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.531074] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 is going to be updated. [ 1206.587611] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3f796883-7322-4113-bfa9-5a64b4903a46',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.592869] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.592869] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.592869] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.592869] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.593258] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.611677] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 in Status: IN_PROGRESS for 2s [ 1206.743167] env[66502]: INFO networking_nsxv3.common.synchronization [None req-ddd09ccb-6e6e-45cb-b4f2-9b43a63d25d3 tempest-AttachInterfacesTestJSON-1531294335 tempest-AttachInterfacesTestJSON-1531294335-project-member] Enqueued Resource ID: 3f796883-7322-4113-bfa9-5a64b4903a46 with Priority: HIGHEST for action security_group_members [ 1206.744178] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f796883-7322-4113-bfa9-5a64b4903a46 with Priority: HIGHEST for action security_group_members [ 1206.744623] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f796883-7322-4113-bfa9-5a64b4903a46 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.744755] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.945362] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.945582] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.945582] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.945781] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.980879] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.981050] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.981134] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.981197] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.981401] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.981478] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.981566] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c04d1b14-a58f-4eee-b805-5b75e4c0afc4 is going to be updated. [ 1207.030052] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.030715] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.030715] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.030715] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.030715] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.044090] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c04d1b14-a58f-4eee-b805-5b75e4c0afc4 in Status: IN_PROGRESS for 2s [ 1207.090930] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.091131] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.091208] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.091433] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.091542] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.091622] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f796883-7322-4113-bfa9-5a64b4903a46 is going to be updated. [ 1207.129727] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.129727] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.129727] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.129727] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.129727] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.140332] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f796883-7322-4113-bfa9-5a64b4903a46 in Status: IN_PROGRESS for 2s [ 1207.241228] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 670eb61a-b688-45b2-9400-64232c7b8af0 in Status: IN_PROGRESS for 4s [ 1207.248983] env[66502]: INFO networking_nsxv3.common.synchronization [req-6bb63f42-7839-43ec-bb5b-71ad65536419 req-1b69b1cf-87a3-406b-bdb2-2d319b804525 tempest-ServersNegativeTestMultiTenantJSON-35168583 tempest-ServersNegativeTestMultiTenantJSON-35168583-project-member] Enqueued Resource ID: 62257f18-fec2-4d84-abfc-4bb2cbec54bc with Priority: HIGHEST for action security_group_members [ 1207.249791] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62257f18-fec2-4d84-abfc-4bb2cbec54bc with Priority: HIGHEST for action security_group_members [ 1207.250359] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-62257f18-fec2-4d84-abfc-4bb2cbec54bc taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.250641] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62257f18-fec2-4d84-abfc-4bb2cbec54bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.251029] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62257f18-fec2-4d84-abfc-4bb2cbec54bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.251198] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62257f18-fec2-4d84-abfc-4bb2cbec54bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.253590] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.253590] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.253590] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.253590] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.253590] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.253590] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62257f18-fec2-4d84-abfc-4bb2cbec54bc',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1207.755308] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.755494] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.755574] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.755799] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.755893] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.756109] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.756192] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.756249] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.756400] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.756543] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.756581] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62257f18-fec2-4d84-abfc-4bb2cbec54bc is going to be updated. [ 1207.787960] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.788084] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.788234] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.788840] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.788840] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.803402] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62257f18-fec2-4d84-abfc-4bb2cbec54bc in Status: IN_PROGRESS for 2s [ 1207.913430] env[66502]: INFO networking_nsxv3.common.synchronization [req-34b8d1ce-58d2-4fa0-be65-c248a47c4067 req-e5767679-3d84-48b4-bc60-5e5b828bcbb0 tempest-AttachVolumeShelveTestJSON-163785099 tempest-AttachVolumeShelveTestJSON-163785099-project-member] Enqueued Resource ID: a5eea73e-9fb6-401e-a5a6-756487d3d58d with Priority: HIGHEST for action security_group_members [ 1207.914348] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5eea73e-9fb6-401e-a5a6-756487d3d58d with Priority: HIGHEST for action security_group_members [ 1207.914696] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5eea73e-9fb6-401e-a5a6-756487d3d58d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.914841] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5eea73e-9fb6-401e-a5a6-756487d3d58d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.914919] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5eea73e-9fb6-401e-a5a6-756487d3d58d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.915297] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5eea73e-9fb6-401e-a5a6-756487d3d58d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.915640] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.915640] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.915640] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.915827] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.915901] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.916018] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5eea73e-9fb6-401e-a5a6-756487d3d58d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.257936] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-458 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.258299] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-458" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.258299] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-458" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.258551] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-458" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.259090] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.259273] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.259389] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.259612] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.259754] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.259967] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1208.260090] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1208.260198] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1208.260302] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1208.260406] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1208.260507] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1208.260636] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1208.279406] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1208.279603] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1208.279692] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1208.279871] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-458" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.280222] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-367342aa-9a14-4b9c-a8ff-41daf9d9feda taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.280392] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-367342aa-9a14-4b9c-a8ff-41daf9d9feda" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.280510] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-367342aa-9a14-4b9c-a8ff-41daf9d9feda" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.280939] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-367342aa-9a14-4b9c-a8ff-41daf9d9feda" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.281089] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('367342aa-9a14-4b9c-a8ff-41daf9d9feda',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1208.418304] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.418504] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.418626] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.418929] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.419111] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.419386] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.419535] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.419632] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.419878] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.420033] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.420157] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5eea73e-9fb6-401e-a5a6-756487d3d58d already deleted. [ 1208.420282] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5eea73e-9fb6-401e-a5a6-756487d3d58d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.631513] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 in Status: SUCCESS [ 1208.631766] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.783689] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.783967] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.784077] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.784320] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.784466] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.784622] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 367342aa-9a14-4b9c-a8ff-41daf9d9feda not found, creating... [ 1208.784961] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.785102] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.785163] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.785370] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.785503] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.785780] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.785931] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.786054] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.786436] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.786589] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.786737] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 367342aa-9a14-4b9c-a8ff-41daf9d9feda is going to be created. [ 1208.807571] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1208.807791] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1208.807911] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1208.808201] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1208.808428] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1208.808714] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-367342aa-9a14-4b9c-a8ff-41daf9d9feda" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.054140] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c04d1b14-a58f-4eee-b805-5b75e4c0afc4 in Status: SUCCESS [ 1209.054333] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c04d1b14-a58f-4eee-b805-5b75e4c0afc4 deletion is rescheduled due to dependency. [ 1209.054456] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c04d1b14-a58f-4eee-b805-5b75e4c0afc4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.151421] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f796883-7322-4113-bfa9-5a64b4903a46 in Status: SUCCESS [ 1209.151635] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.151816] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.152109] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.152304] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.152422] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.152494] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.152648] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.152728] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.152832] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f796883-7322-4113-bfa9-5a64b4903a46',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.252256] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 670eb61a-b688-45b2-9400-64232c7b8af0 in Status: SUCCESS [ 1209.252844] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 670eb61a-b688-45b2-9400-64232c7b8af0 deletion is rescheduled due to dependency. [ 1209.252844] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.481884] env[66502]: INFO networking_nsxv3.common.synchronization [req-31b52ec1-1ab2-4f31-8b63-40236ebc5020 req-7c8c48c9-961a-49e7-9d6e-b34a96634ae6 tempest-AttachInterfacesTestJSON-1531294335 tempest-AttachInterfacesTestJSON-1531294335-project-member] Enqueued Resource ID: fabd7a28-e5fa-4d14-9bb3-bfd99d170f07 with Priority: HIGHEST for action security_group_members [ 1209.482441] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fabd7a28-e5fa-4d14-9bb3-bfd99d170f07 with Priority: HIGHEST for action security_group_members [ 1209.482779] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-fabd7a28-e5fa-4d14-9bb3-bfd99d170f07 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.482895] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fabd7a28-e5fa-4d14-9bb3-bfd99d170f07" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.482972] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fabd7a28-e5fa-4d14-9bb3-bfd99d170f07" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.483290] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fabd7a28-e5fa-4d14-9bb3-bfd99d170f07" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.483492] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.483635] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.483742] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.483957] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.484100] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.484238] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fabd7a28-e5fa-4d14-9bb3-bfd99d170f07',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.539373] env[66502]: INFO networking_nsxv3.common.synchronization [req-34b8d1ce-58d2-4fa0-be65-c248a47c4067 req-7b799a6f-79bf-4fb4-a801-824b22c8c570 service nova] Enqueued Resource ID: a5eea73e-9fb6-401e-a5a6-756487d3d58d with Priority: HIGHEST for action security_group_rules [ 1209.539373] env[66502]: INFO networking_nsxv3.common.synchronization [req-34b8d1ce-58d2-4fa0-be65-c248a47c4067 req-7b799a6f-79bf-4fb4-a801-824b22c8c570 service nova] Enqueued Resource ID: a5eea73e-9fb6-401e-a5a6-756487d3d58d with Priority: HIGHEST for action security_group_members [ 1209.539373] env[66502]: INFO networking_nsxv3.common.synchronization [req-34b8d1ce-58d2-4fa0-be65-c248a47c4067 req-7b799a6f-79bf-4fb4-a801-824b22c8c570 service nova] Enqueued Resource ID: 367342aa-9a14-4b9c-a8ff-41daf9d9feda with Priority: HIGHEST for action port [ 1209.542417] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5eea73e-9fb6-401e-a5a6-756487d3d58d with Priority: HIGHEST for action security_group_rules [ 1209.542417] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5eea73e-9fb6-401e-a5a6-756487d3d58d with Priority: HIGHEST for action security_group_members [ 1209.542417] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 367342aa-9a14-4b9c-a8ff-41daf9d9feda with Priority: HIGHEST for action port [ 1209.542417] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5eea73e-9fb6-401e-a5a6-756487d3d58d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.542417] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5eea73e-9fb6-401e-a5a6-756487d3d58d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.542417] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5eea73e-9fb6-401e-a5a6-756487d3d58d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.542417] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5eea73e-9fb6-401e-a5a6-756487d3d58d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.542417] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5eea73e-9fb6-401e-a5a6-756487d3d58d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.543026] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5eea73e-9fb6-401e-a5a6-756487d3d58d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.543103] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5eea73e-9fb6-401e-a5a6-756487d3d58d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.545776] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5eea73e-9fb6-401e-a5a6-756487d3d58d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.545776] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5eea73e-9fb6-401e-a5a6-756487d3d58d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.545776] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.545776] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.545776] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.545776] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.545776] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.545776] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5eea73e-9fb6-401e-a5a6-756487d3d58d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.546137] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-367342aa-9a14-4b9c-a8ff-41daf9d9feda taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.546137] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-367342aa-9a14-4b9c-a8ff-41daf9d9feda" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.546137] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-367342aa-9a14-4b9c-a8ff-41daf9d9feda" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.546336] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-367342aa-9a14-4b9c-a8ff-41daf9d9feda" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.546458] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('367342aa-9a14-4b9c-a8ff-41daf9d9feda',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.655665] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.655842] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.655842] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.656081] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.656201] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.656597] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.656597] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.656597] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.656836] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.656836] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.656952] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f796883-7322-4113-bfa9-5a64b4903a46 is going to be updated. [ 1209.698643] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.698643] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.698643] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.698643] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.698643] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.707989] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f796883-7322-4113-bfa9-5a64b4903a46 in Status: IN_PROGRESS for 2s [ 1209.817717] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62257f18-fec2-4d84-abfc-4bb2cbec54bc in Status: SUCCESS [ 1209.817897] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62257f18-fec2-4d84-abfc-4bb2cbec54bc deletion is rescheduled due to dependency. [ 1209.818085] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62257f18-fec2-4d84-abfc-4bb2cbec54bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.986163] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.986387] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.986387] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.986592] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.986680] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.986863] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.986961] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.987038] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.987185] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.987304] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.987342] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fabd7a28-e5fa-4d14-9bb3-bfd99d170f07 is going to be updated. [ 1210.014503] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.014846] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.015057] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.015330] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.015552] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.028180] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fabd7a28-e5fa-4d14-9bb3-bfd99d170f07 in Status: IN_PROGRESS for 2s [ 1210.049688] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a5eea73e-9fb6-401e-a5a6-756487d3d58d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.050931] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5eea73e-9fb6-401e-a5a6-756487d3d58d taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.051084] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5eea73e-9fb6-401e-a5a6-756487d3d58d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.051454] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 367342aa-9a14-4b9c-a8ff-41daf9d9feda with status ACTIVE [ 1210.051632] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.051754] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.051823] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.052121] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.052203] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.052371] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.052552] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.052552] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.052703] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.052803] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.053034] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.053177] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.053215] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.053365] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.053442] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.053551] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 367342aa-9a14-4b9c-a8ff-41daf9d9feda is going to be updated. [ 1210.077043] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.077254] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.077254] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.077480] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.077605] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.077766] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-367342aa-9a14-4b9c-a8ff-41daf9d9feda" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.552404] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a5eea73e-9fb6-401e-a5a6-756487d3d58d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.054683] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.054847] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.054910] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.055143] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.055233] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.055352] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5eea73e-9fb6-401e-a5a6-756487d3d58d is going to be created. [ 1211.084400] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.084546] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.084616] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.084836] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.084995] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.096875] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5eea73e-9fb6-401e-a5a6-756487d3d58d in Status: UNINITIALIZED for 2s [ 1211.719460] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f796883-7322-4113-bfa9-5a64b4903a46 in Status: SUCCESS [ 1211.719784] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f796883-7322-4113-bfa9-5a64b4903a46 deletion is rescheduled due to dependency. [ 1211.719784] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.844718] env[66502]: INFO networking_nsxv3.common.synchronization [None req-45bea13d-f2a4-495c-a770-fb47d85026a3 tempest-AttachVolumeTestJSON-1757376105 tempest-AttachVolumeTestJSON-1757376105-project-member] Enqueued Resource ID: 857afeba-8497-43a2-a5f2-438f06b14e01 with Priority: HIGHEST for action security_group_rules [ 1211.845148] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 857afeba-8497-43a2-a5f2-438f06b14e01 with Priority: HIGHEST for action security_group_rules [ 1211.845444] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-857afeba-8497-43a2-a5f2-438f06b14e01 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.845557] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-857afeba-8497-43a2-a5f2-438f06b14e01" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.845619] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-857afeba-8497-43a2-a5f2-438f06b14e01" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.845875] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-857afeba-8497-43a2-a5f2-438f06b14e01" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.845950] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('857afeba-8497-43a2-a5f2-438f06b14e01',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.922954] env[66502]: INFO networking_nsxv3.common.synchronization [None req-ddda20da-a350-4bf0-b561-0090f1416e96 tempest-AttachVolumeTestJSON-1757376105 tempest-AttachVolumeTestJSON-1757376105-project-member] Enqueued Resource ID: 857afeba-8497-43a2-a5f2-438f06b14e01 with Priority: HIGHEST for action security_group_rules [ 1211.923526] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 857afeba-8497-43a2-a5f2-438f06b14e01 with Priority: HIGHEST for action security_group_rules [ 1211.923834] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-857afeba-8497-43a2-a5f2-438f06b14e01 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.923952] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-857afeba-8497-43a2-a5f2-438f06b14e01" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.041067] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fabd7a28-e5fa-4d14-9bb3-bfd99d170f07 in Status: SUCCESS [ 1212.041233] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fabd7a28-e5fa-4d14-9bb3-bfd99d170f07 deletion is rescheduled due to dependency. [ 1212.041352] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fabd7a28-e5fa-4d14-9bb3-bfd99d170f07" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.366455] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.366639] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.366724] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.366871] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.366957] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.367061] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 857afeba-8497-43a2-a5f2-438f06b14e01 already deleted. [ 1212.367144] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-857afeba-8497-43a2-a5f2-438f06b14e01" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.367284] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-857afeba-8497-43a2-a5f2-438f06b14e01" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.367437] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-857afeba-8497-43a2-a5f2-438f06b14e01" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.367519] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('857afeba-8497-43a2-a5f2-438f06b14e01',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.533913] env[66502]: INFO networking_nsxv3.common.synchronization [req-122cd1cd-57af-43ec-9143-095655c9b90b req-4961d159-d9f3-4a2e-b3a7-cc57f69c6de1 tempest-ServerActionsTestOtherA-1204678764 tempest-ServerActionsTestOtherA-1204678764-project-member] Enqueued Resource ID: da4454aa-c9b4-48df-a3af-94b687746e31 with Priority: HIGHEST for action security_group_members [ 1212.534710] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da4454aa-c9b4-48df-a3af-94b687746e31 with Priority: HIGHEST for action security_group_members [ 1212.535128] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-da4454aa-c9b4-48df-a3af-94b687746e31 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.535255] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.535322] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.535522] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.535808] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.536507] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.536671] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.536962] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.537142] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.537306] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da4454aa-c9b4-48df-a3af-94b687746e31',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.891102] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1212.891558] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1212.891558] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1212.892885] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1212.892885] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.892885] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 857afeba-8497-43a2-a5f2-438f06b14e01 already deleted. [ 1212.892885] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-857afeba-8497-43a2-a5f2-438f06b14e01" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.042070] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.042263] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.042308] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.042511] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.042603] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.042794] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.042900] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.042948] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.043106] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.043315] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.043452] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da4454aa-c9b4-48df-a3af-94b687746e31 is going to be updated. [ 1213.070663] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.070862] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.070925] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.071140] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.071287] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.080644] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da4454aa-c9b4-48df-a3af-94b687746e31 in Status: IN_PROGRESS for 2s [ 1213.107374] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5eea73e-9fb6-401e-a5a6-756487d3d58d in Status: SUCCESS [ 1213.107934] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5eea73e-9fb6-401e-a5a6-756487d3d58d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.107934] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5eea73e-9fb6-401e-a5a6-756487d3d58d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.108122] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5eea73e-9fb6-401e-a5a6-756487d3d58d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.108322] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.108437] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.108549] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.108707] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.109087] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.109087] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5eea73e-9fb6-401e-a5a6-756487d3d58d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.109087] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a5eea73e-9fb6-401e-a5a6-756487d3d58d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.610725] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a5eea73e-9fb6-401e-a5a6-756487d3d58d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1214.113024] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a5eea73e-9fb6-401e-a5a6-756487d3d58d: rpc.has_security_group_logging(os_id): False [ 1214.134858] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.135045] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.135123] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.135378] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.135471] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.135734] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.135854] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.135920] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.136111] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.136202] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.136355] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5eea73e-9fb6-401e-a5a6-756487d3d58d is going to be created. [ 1214.210171] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1214.210171] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1214.210171] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1214.210171] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1214.210171] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1214.221969] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5eea73e-9fb6-401e-a5a6-756487d3d58d in Status: IN_PROGRESS for 2s [ 1215.092440] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da4454aa-c9b4-48df-a3af-94b687746e31 in Status: SUCCESS [ 1215.092702] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da4454aa-c9b4-48df-a3af-94b687746e31 deletion is rescheduled due to dependency. [ 1215.092766] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.234890] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5eea73e-9fb6-401e-a5a6-756487d3d58d in Status: SUCCESS [ 1216.235312] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5eea73e-9fb6-401e-a5a6-756487d3d58d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.735916] env[66502]: INFO networking_nsxv3.common.synchronization [None req-be11626f-a6f4-49c5-be24-9fb36df34783 tempest-AttachInterfacesTestJSON-1531294335 tempest-AttachInterfacesTestJSON-1531294335-project-member] Enqueued Resource ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 with Priority: HIGHEST for action security_group_rules [ 1216.735916] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 with Priority: HIGHEST for action security_group_rules [ 1216.735916] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1178ec1-223d-4ab7-9bf8-24c40a589123 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.735916] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.735916] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.735916] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.735916] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1178ec1-223d-4ab7-9bf8-24c40a589123',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.818685] env[66502]: INFO networking_nsxv3.common.synchronization [None req-d3a9c6aa-d01c-4ea3-98ec-46e3169e5e3d tempest-AttachInterfacesTestJSON-1531294335 tempest-AttachInterfacesTestJSON-1531294335-project-member] Enqueued Resource ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 with Priority: HIGHEST for action security_group_rules [ 1216.819278] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 with Priority: HIGHEST for action security_group_rules [ 1216.819566] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1178ec1-223d-4ab7-9bf8-24c40a589123 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.819744] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.260679] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.261021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.261021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.261208] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.261317] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.261416] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 already deleted. [ 1217.261521] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.261682] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.261865] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.261971] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1178ec1-223d-4ab7-9bf8-24c40a589123',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1217.784351] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.784495] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.784560] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.784782] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.784873] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.784969] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 already deleted. [ 1217.785067] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.057647] env[66502]: INFO networking_nsxv3.common.synchronization [req-03a87a38-29ba-4fdf-a788-53bf64e486a8 req-e4f422b0-ac50-4536-bd46-62b515fdf30b tempest-ServerActionsTestOtherB-501490242 tempest-ServerActionsTestOtherB-501490242-project-member] Enqueued Resource ID: 670eb61a-b688-45b2-9400-64232c7b8af0 with Priority: HIGHEST for action security_group_members [ 1218.057647] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 670eb61a-b688-45b2-9400-64232c7b8af0 with Priority: HIGHEST for action security_group_members [ 1218.057647] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-670eb61a-b688-45b2-9400-64232c7b8af0 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.057647] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.057867] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.057900] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.058523] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.058523] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.058523] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.058690] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.058805] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.058858] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('670eb61a-b688-45b2-9400-64232c7b8af0',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.442875] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-427 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.443269] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-427" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.443269] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-427" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.443495] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-427" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.443750] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.444325] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.444523] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.444837] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.444994] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.445219] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1218.445334] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1218.445446] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1218.445558] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1218.445815] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1218.445884] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1218.445995] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1218.470042] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1218.470042] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1218.470042] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1218.470042] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-427" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.470042] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-8376241b-f2d7-4f78-a4fb-023587861732 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.470042] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-8376241b-f2d7-4f78-a4fb-023587861732" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.470042] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-8376241b-f2d7-4f78-a4fb-023587861732" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.470042] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-8376241b-f2d7-4f78-a4fb-023587861732" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.470042] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8376241b-f2d7-4f78-a4fb-023587861732',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1218.563109] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.563287] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.563357] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.563575] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.563666] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.563859] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.563957] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.564694] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.565080] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.565209] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.565344] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 670eb61a-b688-45b2-9400-64232c7b8af0 is going to be updated. [ 1218.600984] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.601154] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.601235] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.601489] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.601635] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.610782] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 670eb61a-b688-45b2-9400-64232c7b8af0 in Status: IN_PROGRESS for 2s [ 1218.973988] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.974328] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.974381] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.974671] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.975095] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.975095] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port 8376241b-f2d7-4f78-a4fb-023587861732 not found, creating... [ 1218.975220] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.975424] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.975481] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.975665] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.975821] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.976188] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1218.976373] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1218.976529] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1218.976699] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1218.976827] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1218.976961] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: 8376241b-f2d7-4f78-a4fb-023587861732 is going to be created. [ 1219.006321] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.006528] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.006652] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.006927] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.007167] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.007390] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-8376241b-f2d7-4f78-a4fb-023587861732" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.698678] env[66502]: INFO networking_nsxv3.common.synchronization [req-03a87a38-29ba-4fdf-a788-53bf64e486a8 req-ddf09191-5b02-43ba-86db-fae08db7d631 service nova] Enqueued Resource ID: 670eb61a-b688-45b2-9400-64232c7b8af0 with Priority: HIGHEST for action security_group_rules [ 1219.698678] env[66502]: INFO networking_nsxv3.common.synchronization [req-03a87a38-29ba-4fdf-a788-53bf64e486a8 req-ddf09191-5b02-43ba-86db-fae08db7d631 service nova] Enqueued Resource ID: 670eb61a-b688-45b2-9400-64232c7b8af0 with Priority: HIGHEST for action security_group_members [ 1219.698678] env[66502]: INFO networking_nsxv3.common.synchronization [req-03a87a38-29ba-4fdf-a788-53bf64e486a8 req-ddf09191-5b02-43ba-86db-fae08db7d631 service nova] Enqueued Resource ID: 8376241b-f2d7-4f78-a4fb-023587861732 with Priority: HIGHEST for action port [ 1219.699545] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 670eb61a-b688-45b2-9400-64232c7b8af0 with Priority: HIGHEST for action security_group_rules [ 1219.699545] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 670eb61a-b688-45b2-9400-64232c7b8af0 with Priority: HIGHEST for action security_group_members [ 1219.699545] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8376241b-f2d7-4f78-a4fb-023587861732 with Priority: HIGHEST for action port [ 1219.699701] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-670eb61a-b688-45b2-9400-64232c7b8af0 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.699812] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.699896] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.700061] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.700148] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('670eb61a-b688-45b2-9400-64232c7b8af0',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1219.701108] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-670eb61a-b688-45b2-9400-64232c7b8af0 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.701108] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.701242] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-8376241b-f2d7-4f78-a4fb-023587861732 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1219.701571] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8376241b-f2d7-4f78-a4fb-023587861732" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1219.701571] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8376241b-f2d7-4f78-a4fb-023587861732" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1219.701571] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8376241b-f2d7-4f78-a4fb-023587861732" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1219.701771] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8376241b-f2d7-4f78-a4fb-023587861732',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.201978] env[66502]: INFO networking_nsxv3.common.synchronization [None req-1844ba37-d5a8-429a-9c93-ec5b716fe301 tempest-ServerActionsTestOtherA-1204678764 tempest-ServerActionsTestOtherA-1204678764-project-member] Enqueued Resource ID: 16e42bc2-4203-42a4-85a6-b34ec02b298e with Priority: HIGHEST for action security_group_rules [ 1220.202509] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e42bc2-4203-42a4-85a6-b34ec02b298e with Priority: HIGHEST for action security_group_rules [ 1220.202817] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16e42bc2-4203-42a4-85a6-b34ec02b298e taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.202954] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16e42bc2-4203-42a4-85a6-b34ec02b298e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.203032] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16e42bc2-4203-42a4-85a6-b34ec02b298e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.203296] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16e42bc2-4203-42a4-85a6-b34ec02b298e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.203376] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16e42bc2-4203-42a4-85a6-b34ec02b298e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.204146] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8376241b-f2d7-4f78-a4fb-023587861732 with status ACTIVE [ 1220.204720] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.204720] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.204720] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.204720] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.204720] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.204992] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.204992] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.205089] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.205171] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.205248] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.205441] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.205554] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.205616] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.207039] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.207039] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.207039] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8376241b-f2d7-4f78-a4fb-023587861732 is going to be updated. [ 1220.207039] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-670eb61a-b688-45b2-9400-64232c7b8af0 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.207039] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.229263] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.229458] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.229535] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.229686] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.229814] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.229970] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8376241b-f2d7-4f78-a4fb-023587861732" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.300380] env[66502]: INFO networking_nsxv3.common.synchronization [None req-d7a71b93-5db8-4c67-9ae9-dfae85f3d204 tempest-ServerActionsTestOtherA-1204678764 tempest-ServerActionsTestOtherA-1204678764-project-member] Enqueued Resource ID: 16e42bc2-4203-42a4-85a6-b34ec02b298e with Priority: HIGHEST for action security_group_rules [ 1220.300865] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e42bc2-4203-42a4-85a6-b34ec02b298e with Priority: HIGHEST for action security_group_rules [ 1220.301291] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16e42bc2-4203-42a4-85a6-b34ec02b298e taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.301408] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16e42bc2-4203-42a4-85a6-b34ec02b298e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.620903] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 670eb61a-b688-45b2-9400-64232c7b8af0 in Status: SUCCESS [ 1220.621156] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 670eb61a-b688-45b2-9400-64232c7b8af0 deletion is rescheduled due to dependency. [ 1220.621275] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.621430] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.621654] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.621836] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.621940] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.622018] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.622174] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.622255] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.622348] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('670eb61a-b688-45b2-9400-64232c7b8af0',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1220.727298] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.727685] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.727685] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.727763] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.727795] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.727889] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16e42bc2-4203-42a4-85a6-b34ec02b298e already deleted. [ 1220.727966] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16e42bc2-4203-42a4-85a6-b34ec02b298e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.728126] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16e42bc2-4203-42a4-85a6-b34ec02b298e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.728279] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16e42bc2-4203-42a4-85a6-b34ec02b298e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.728435] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16e42bc2-4203-42a4-85a6-b34ec02b298e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.125342] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('670eb61a-b688-45b2-9400-64232c7b8af0',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.248572] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.248572] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.248572] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.248852] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.248852] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.248852] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16e42bc2-4203-42a4-85a6-b34ec02b298e already deleted. [ 1221.248952] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16e42bc2-4203-42a4-85a6-b34ec02b298e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.627872] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('670eb61a-b688-45b2-9400-64232c7b8af0',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.930214] env[66502]: INFO networking_nsxv3.common.synchronization [req-e0c1f80b-0904-408f-a8fd-0f3bb8f955bb req-2b580ecc-2343-4c8b-beb9-a00f91878d65 tempest-AttachVolumeTestJSON-1757376105 tempest-AttachVolumeTestJSON-1757376105-project-member] Enqueued Resource ID: 857afeba-8497-43a2-a5f2-438f06b14e01 with Priority: HIGHEST for action security_group_members [ 1221.930885] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 857afeba-8497-43a2-a5f2-438f06b14e01 with Priority: HIGHEST for action security_group_members [ 1221.930925] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-857afeba-8497-43a2-a5f2-438f06b14e01 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.931134] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-857afeba-8497-43a2-a5f2-438f06b14e01" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.931270] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-857afeba-8497-43a2-a5f2-438f06b14e01" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.931596] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-857afeba-8497-43a2-a5f2-438f06b14e01" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.931785] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.931914] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.932047] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.932216] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.932344] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.932461] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('857afeba-8497-43a2-a5f2-438f06b14e01',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.133190] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.133190] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.133190] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.133190] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.133497] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.133497] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 670eb61a-b688-45b2-9400-64232c7b8af0 is going to be updated. [ 1222.168350] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.168746] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.168746] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.168917] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.169262] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.179227] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 670eb61a-b688-45b2-9400-64232c7b8af0 in Status: IN_PROGRESS for 2s [ 1222.284061] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-775 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.284061] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-775" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.284061] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-775" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.284310] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-775" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.284466] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.284615] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.284727] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.284931] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.285124] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.285308] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1222.285427] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1222.285567] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1222.285680] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1222.285788] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1222.285907] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1222.286055] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1222.307500] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1222.307657] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1222.307796] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1222.307966] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-775" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.308309] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-0ce42259-9f53-41da-99e6-6862c59a94e1 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.308481] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-0ce42259-9f53-41da-99e6-6862c59a94e1" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.308596] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-0ce42259-9f53-41da-99e6-6862c59a94e1" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.309243] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-0ce42259-9f53-41da-99e6-6862c59a94e1" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.309467] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ce42259-9f53-41da-99e6-6862c59a94e1',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1222.435597] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.435818] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.435818] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.436089] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.436196] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.436419] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.436521] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.436583] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.436734] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.436809] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.436892] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 857afeba-8497-43a2-a5f2-438f06b14e01 already deleted. [ 1222.436975] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-857afeba-8497-43a2-a5f2-438f06b14e01" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.812224] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.812455] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.812544] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.812833] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.812982] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.813154] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port 0ce42259-9f53-41da-99e6-6862c59a94e1 not found, creating... [ 1222.813568] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.813739] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.813859] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.814116] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.814257] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.814544] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.814699] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.814817] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.815036] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.815176] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.815315] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: 0ce42259-9f53-41da-99e6-6862c59a94e1 is going to be created. [ 1222.835917] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1222.836229] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1222.836304] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1222.836721] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1222.836827] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1222.837013] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-0ce42259-9f53-41da-99e6-6862c59a94e1" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.524990] env[66502]: INFO networking_nsxv3.common.synchronization [req-e0c1f80b-0904-408f-a8fd-0f3bb8f955bb req-ce29c5a3-eac0-4f67-aa4f-ef18f0b51209 service nova] Enqueued Resource ID: 857afeba-8497-43a2-a5f2-438f06b14e01 with Priority: HIGHEST for action security_group_rules [ 1223.525251] env[66502]: INFO networking_nsxv3.common.synchronization [req-e0c1f80b-0904-408f-a8fd-0f3bb8f955bb req-ce29c5a3-eac0-4f67-aa4f-ef18f0b51209 service nova] Enqueued Resource ID: 857afeba-8497-43a2-a5f2-438f06b14e01 with Priority: HIGHEST for action security_group_members [ 1223.525294] env[66502]: INFO networking_nsxv3.common.synchronization [req-e0c1f80b-0904-408f-a8fd-0f3bb8f955bb req-ce29c5a3-eac0-4f67-aa4f-ef18f0b51209 service nova] Enqueued Resource ID: 0ce42259-9f53-41da-99e6-6862c59a94e1 with Priority: HIGHEST for action port [ 1223.525506] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 857afeba-8497-43a2-a5f2-438f06b14e01 with Priority: HIGHEST for action security_group_rules [ 1223.525634] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 857afeba-8497-43a2-a5f2-438f06b14e01 with Priority: HIGHEST for action security_group_members [ 1223.525728] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ce42259-9f53-41da-99e6-6862c59a94e1 with Priority: HIGHEST for action port [ 1223.526404] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-857afeba-8497-43a2-a5f2-438f06b14e01 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.526538] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-857afeba-8497-43a2-a5f2-438f06b14e01" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.526663] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-857afeba-8497-43a2-a5f2-438f06b14e01" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.526799] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-857afeba-8497-43a2-a5f2-438f06b14e01" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.526870] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('857afeba-8497-43a2-a5f2-438f06b14e01',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.528158] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-857afeba-8497-43a2-a5f2-438f06b14e01 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.528372] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-857afeba-8497-43a2-a5f2-438f06b14e01" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.528444] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-857afeba-8497-43a2-a5f2-438f06b14e01" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.528613] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-857afeba-8497-43a2-a5f2-438f06b14e01" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.528758] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.528852] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.528913] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.529077] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.529169] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1223.530419] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('857afeba-8497-43a2-a5f2-438f06b14e01',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1223.531203] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ce42259-9f53-41da-99e6-6862c59a94e1 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1223.531682] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ce42259-9f53-41da-99e6-6862c59a94e1" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1223.531797] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ce42259-9f53-41da-99e6-6862c59a94e1" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1223.531989] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ce42259-9f53-41da-99e6-6862c59a94e1" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1223.532156] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ce42259-9f53-41da-99e6-6862c59a94e1',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.034333] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('857afeba-8497-43a2-a5f2-438f06b14e01',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.035566] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-857afeba-8497-43a2-a5f2-438f06b14e01 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.035754] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-857afeba-8497-43a2-a5f2-438f06b14e01" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.036296] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0ce42259-9f53-41da-99e6-6862c59a94e1 with status ACTIVE [ 1224.036296] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.036296] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.036296] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.036557] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.036557] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.036659] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.036748] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.036790] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.036942] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.037028] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.037195] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.037290] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.037344] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.039037] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.039037] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.039037] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0ce42259-9f53-41da-99e6-6862c59a94e1 is going to be updated. [ 1224.061828] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.062016] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.062162] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.062355] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.062594] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.062798] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ce42259-9f53-41da-99e6-6862c59a94e1" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.164388] env[66502]: INFO networking_nsxv3.common.synchronization [req-31223feb-3cba-4e86-8131-24d424a39ffb req-7b19ff2d-9e12-48c4-9e15-1a9df225744c tempest-AttachInterfacesTestJSON-1531294335 tempest-AttachInterfacesTestJSON-1531294335-project-member] Enqueued Resource ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 with Priority: HIGHEST for action security_group_members [ 1224.165033] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 with Priority: HIGHEST for action security_group_members [ 1224.165395] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1178ec1-223d-4ab7-9bf8-24c40a589123 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.165549] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.165639] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.165921] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.166172] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.166318] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.166404] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.166599] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.166694] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.166795] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f1178ec1-223d-4ab7-9bf8-24c40a589123',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.190561] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 670eb61a-b688-45b2-9400-64232c7b8af0 in Status: SUCCESS [ 1224.190845] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.190845] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.191143] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.191259] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.191379] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.191444] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.191607] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.191688] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.191775] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.191866] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('670eb61a-b688-45b2-9400-64232c7b8af0',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.540077] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('857afeba-8497-43a2-a5f2-438f06b14e01',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.542453] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-584 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.542641] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-584" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.542764] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-584" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.543083] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-584" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.543388] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.543550] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.543842] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.543842] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.543963] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.544175] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1224.544286] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1224.544394] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1224.544501] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1224.544609] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1224.544712] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1224.544840] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1224.573823] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1224.574014] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.029 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1224.574186] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1224.574372] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-584" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.574685] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-78f5f630-8f4f-4460-8aae-e5a4a0a666e5 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.574853] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-78f5f630-8f4f-4460-8aae-e5a4a0a666e5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.574962] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-78f5f630-8f4f-4460-8aae-e5a4a0a666e5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.575304] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-78f5f630-8f4f-4460-8aae-e5a4a0a666e5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.575443] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78f5f630-8f4f-4460-8aae-e5a4a0a666e5',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1224.669298] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.669506] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.669552] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.669757] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.669850] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.670060] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1224.670170] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1224.670237] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1224.670420] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1224.670513] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.670630] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 already deleted. [ 1224.670723] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1224.694354] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('670eb61a-b688-45b2-9400-64232c7b8af0',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.046880] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.047108] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.047108] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.047281] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.047375] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.047472] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 857afeba-8497-43a2-a5f2-438f06b14e01 is going to be created. [ 1225.071431] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.071666] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.071666] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.071846] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.072025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.077777] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.077960] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.078102] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.078437] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.078581] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.078732] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 78f5f630-8f4f-4460-8aae-e5a4a0a666e5 not found, creating... [ 1225.078985] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.079222] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.079346] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.079562] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.079696] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.080183] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.080183] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.080337] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.080431] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.080565] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.080691] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 78f5f630-8f4f-4460-8aae-e5a4a0a666e5 is going to be created. [ 1225.084166] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 857afeba-8497-43a2-a5f2-438f06b14e01 in Status: UNINITIALIZED for 2s [ 1225.100896] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.101157] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.101266] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.101535] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.101750] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.101962] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-78f5f630-8f4f-4460-8aae-e5a4a0a666e5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.196307] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 670eb61a-b688-45b2-9400-64232c7b8af0: rpc.has_security_group_logging(os_id): False [ 1225.220481] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.220802] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.220898] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.221205] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.221292] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.221551] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.221670] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.221734] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.221895] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.221972] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.222077] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 670eb61a-b688-45b2-9400-64232c7b8af0 is going to be updated. [ 1225.342682] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.342926] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.342926] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.343112] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.343292] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.373096] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 670eb61a-b688-45b2-9400-64232c7b8af0 in Status: IN_PROGRESS for 2s [ 1225.798560] env[66502]: INFO networking_nsxv3.common.synchronization [req-31223feb-3cba-4e86-8131-24d424a39ffb req-c9aca427-96d1-455b-a92a-55be8a2ff81f service nova] Enqueued Resource ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 with Priority: HIGHEST for action security_group_rules [ 1225.798560] env[66502]: INFO networking_nsxv3.common.synchronization [req-31223feb-3cba-4e86-8131-24d424a39ffb req-c9aca427-96d1-455b-a92a-55be8a2ff81f service nova] Enqueued Resource ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 with Priority: HIGHEST for action security_group_members [ 1225.798560] env[66502]: INFO networking_nsxv3.common.synchronization [req-31223feb-3cba-4e86-8131-24d424a39ffb req-c9aca427-96d1-455b-a92a-55be8a2ff81f service nova] Enqueued Resource ID: 78f5f630-8f4f-4460-8aae-e5a4a0a666e5 with Priority: HIGHEST for action port [ 1225.798560] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 with Priority: HIGHEST for action security_group_rules [ 1225.798560] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 with Priority: HIGHEST for action security_group_members [ 1225.798560] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78f5f630-8f4f-4460-8aae-e5a4a0a666e5 with Priority: HIGHEST for action port [ 1225.803021] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1178ec1-223d-4ab7-9bf8-24c40a589123 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.803021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.803021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.803021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.803021] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1178ec1-223d-4ab7-9bf8-24c40a589123',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.803021] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1178ec1-223d-4ab7-9bf8-24c40a589123 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.803021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.803021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.803021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.803021] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.803021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.803021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.803021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.803021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.804318] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f1178ec1-223d-4ab7-9bf8-24c40a589123',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.805425] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-78f5f630-8f4f-4460-8aae-e5a4a0a666e5 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.806591] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-78f5f630-8f4f-4460-8aae-e5a4a0a666e5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.806874] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-78f5f630-8f4f-4460-8aae-e5a4a0a666e5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.807181] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-78f5f630-8f4f-4460-8aae-e5a4a0a666e5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.807405] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('78f5f630-8f4f-4460-8aae-e5a4a0a666e5',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.948623] env[66502]: INFO networking_nsxv3.common.synchronization [req-97d71ee6-2599-4fdd-98ce-c41f389b4452 req-2e912451-d854-4d54-b8a7-e94fde1fa8a6 tempest-ServerActionsTestOtherA-1204678764 tempest-ServerActionsTestOtherA-1204678764-project-member] Enqueued Resource ID: 16e42bc2-4203-42a4-85a6-b34ec02b298e with Priority: HIGHEST for action security_group_members [ 1225.949156] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e42bc2-4203-42a4-85a6-b34ec02b298e with Priority: HIGHEST for action security_group_members [ 1225.949458] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e42bc2-4203-42a4-85a6-b34ec02b298e taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.949581] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e42bc2-4203-42a4-85a6-b34ec02b298e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.949649] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e42bc2-4203-42a4-85a6-b34ec02b298e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.949937] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e42bc2-4203-42a4-85a6-b34ec02b298e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.950182] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.950287] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.950287] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.950690] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.950690] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.950690] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16e42bc2-4203-42a4-85a6-b34ec02b298e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.294394] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-170 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.295352] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-170" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.295352] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-170" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.295352] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-170" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.295543] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.295669] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.295817] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.296089] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.296273] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.296517] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1226.296694] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1226.296889] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1226.297124] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1226.297338] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1226.297534] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1226.297786] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1226.309670] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f1178ec1-223d-4ab7-9bf8-24c40a589123',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.311041] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1178ec1-223d-4ab7-9bf8-24c40a589123 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.311612] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.312336] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 78f5f630-8f4f-4460-8aae-e5a4a0a666e5 with status ACTIVE [ 1226.312595] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.312762] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.312859] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.313161] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.313296] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.313539] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.313678] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.313802] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.314048] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.314101] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.314369] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.314509] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.314611] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.314969] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.314969] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.315111] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 78f5f630-8f4f-4460-8aae-e5a4a0a666e5 is going to be updated. [ 1226.331758] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1226.331989] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1226.332116] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1226.332255] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-170" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.332587] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-b3b8bb59-73d2-4eb7-87d1-970067e99ccd taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.332762] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-b3b8bb59-73d2-4eb7-87d1-970067e99ccd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.332958] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-b3b8bb59-73d2-4eb7-87d1-970067e99ccd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.333340] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-b3b8bb59-73d2-4eb7-87d1-970067e99ccd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.333489] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3b8bb59-73d2-4eb7-87d1-970067e99ccd',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.346301] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.346494] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.346494] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.346926] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.346926] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.347045] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-78f5f630-8f4f-4460-8aae-e5a4a0a666e5" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.454069] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.454069] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.454069] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.454382] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.454382] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.454490] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.454599] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.454652] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.454802] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.454878] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.454994] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16e42bc2-4203-42a4-85a6-b34ec02b298e already deleted. [ 1226.455084] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e42bc2-4203-42a4-85a6-b34ec02b298e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.813471] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f1178ec1-223d-4ab7-9bf8-24c40a589123',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.835917] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.836297] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.836384] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.836687] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.836870] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.837084] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port b3b8bb59-73d2-4eb7-87d1-970067e99ccd not found, creating... [ 1226.837401] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.837594] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.837744] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.838069] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.838226] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.838534] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.838754] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.839087] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.839274] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.839448] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.839618] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: b3b8bb59-73d2-4eb7-87d1-970067e99ccd is going to be created. [ 1226.863236] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.863512] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.863641] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.863922] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.864170] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.864400] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-b3b8bb59-73d2-4eb7-87d1-970067e99ccd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.096332] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 857afeba-8497-43a2-a5f2-438f06b14e01 in Status: SUCCESS [ 1227.096681] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-857afeba-8497-43a2-a5f2-438f06b14e01" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.096964] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-857afeba-8497-43a2-a5f2-438f06b14e01" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.097318] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-857afeba-8497-43a2-a5f2-438f06b14e01" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.097617] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.097874] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.097955] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.098197] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.098339] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.098483] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-857afeba-8497-43a2-a5f2-438f06b14e01" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.098649] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('857afeba-8497-43a2-a5f2-438f06b14e01',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.316985] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.317197] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.317272] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.317445] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.317536] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.317637] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 is going to be created. [ 1227.342157] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.342307] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.342427] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.342628] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.342800] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.352137] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 in Status: UNINITIALIZED for 2s [ 1227.391019] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 670eb61a-b688-45b2-9400-64232c7b8af0 in Status: SUCCESS [ 1227.391019] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.554837] env[66502]: INFO networking_nsxv3.common.synchronization [req-97d71ee6-2599-4fdd-98ce-c41f389b4452 req-4966a40b-2b13-4903-8f8b-9d8202efb282 service nova] Enqueued Resource ID: 16e42bc2-4203-42a4-85a6-b34ec02b298e with Priority: HIGHEST for action security_group_rules [ 1227.554837] env[66502]: INFO networking_nsxv3.common.synchronization [req-97d71ee6-2599-4fdd-98ce-c41f389b4452 req-4966a40b-2b13-4903-8f8b-9d8202efb282 service nova] Enqueued Resource ID: 16e42bc2-4203-42a4-85a6-b34ec02b298e with Priority: HIGHEST for action security_group_members [ 1227.554837] env[66502]: INFO networking_nsxv3.common.synchronization [req-97d71ee6-2599-4fdd-98ce-c41f389b4452 req-4966a40b-2b13-4903-8f8b-9d8202efb282 service nova] Enqueued Resource ID: b3b8bb59-73d2-4eb7-87d1-970067e99ccd with Priority: HIGHEST for action port [ 1227.555412] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e42bc2-4203-42a4-85a6-b34ec02b298e with Priority: HIGHEST for action security_group_rules [ 1227.555549] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e42bc2-4203-42a4-85a6-b34ec02b298e with Priority: HIGHEST for action security_group_members [ 1227.555643] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b3b8bb59-73d2-4eb7-87d1-970067e99ccd with Priority: HIGHEST for action port [ 1227.555948] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-16e42bc2-4203-42a4-85a6-b34ec02b298e taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.556619] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-16e42bc2-4203-42a4-85a6-b34ec02b298e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.556702] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-16e42bc2-4203-42a4-85a6-b34ec02b298e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.556908] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-16e42bc2-4203-42a4-85a6-b34ec02b298e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.556989] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('16e42bc2-4203-42a4-85a6-b34ec02b298e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.558018] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e42bc2-4203-42a4-85a6-b34ec02b298e taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.558161] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e42bc2-4203-42a4-85a6-b34ec02b298e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.558254] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e42bc2-4203-42a4-85a6-b34ec02b298e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.559298] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e42bc2-4203-42a4-85a6-b34ec02b298e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.559298] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.559298] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.559298] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.559557] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.560118] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.560259] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16e42bc2-4203-42a4-85a6-b34ec02b298e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.561073] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-b3b8bb59-73d2-4eb7-87d1-970067e99ccd taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.561247] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b3b8bb59-73d2-4eb7-87d1-970067e99ccd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.561317] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b3b8bb59-73d2-4eb7-87d1-970067e99ccd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.561474] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b3b8bb59-73d2-4eb7-87d1-970067e99ccd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.561549] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b3b8bb59-73d2-4eb7-87d1-970067e99ccd',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.601984] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('857afeba-8497-43a2-a5f2-438f06b14e01',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.063124] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e42bc2-4203-42a4-85a6-b34ec02b298e taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.063444] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e42bc2-4203-42a4-85a6-b34ec02b298e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.063485] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('16e42bc2-4203-42a4-85a6-b34ec02b298e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.065817] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b3b8bb59-73d2-4eb7-87d1-970067e99ccd with status ACTIVE [ 1228.066021] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.066322] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.066322] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.066443] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.066536] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.066869] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.067058] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.067058] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.067274] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.067330] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.067472] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.067555] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.067918] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.067918] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.067918] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.067918] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b3b8bb59-73d2-4eb7-87d1-970067e99ccd is going to be updated. [ 1228.091394] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.091611] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.091611] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.091826] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.091961] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.092220] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b3b8bb59-73d2-4eb7-87d1-970067e99ccd" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.104583] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 857afeba-8497-43a2-a5f2-438f06b14e01: rpc.has_security_group_logging(os_id): False [ 1228.122121] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.122343] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.122343] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.122579] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.122642] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.123176] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.123176] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.123176] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.123176] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.123403] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.123403] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 857afeba-8497-43a2-a5f2-438f06b14e01 is going to be created. [ 1228.199672] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1228.199938] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1228.199938] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1228.200163] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1228.200340] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1228.210585] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 857afeba-8497-43a2-a5f2-438f06b14e01 in Status: IN_PROGRESS for 2s [ 1228.565985] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('16e42bc2-4203-42a4-85a6-b34ec02b298e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.069877] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.070336] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.070336] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.070409] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.070441] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.070620] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16e42bc2-4203-42a4-85a6-b34ec02b298e is going to be created. [ 1229.095250] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.095503] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.095503] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.095670] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.095825] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.107672] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e42bc2-4203-42a4-85a6-b34ec02b298e in Status: UNINITIALIZED for 2s [ 1229.363253] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 in Status: SUCCESS [ 1229.363484] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.363672] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.363942] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.364211] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.364351] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.364414] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.364583] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.364666] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.364746] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.364831] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f1178ec1-223d-4ab7-9bf8-24c40a589123',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.867468] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f1178ec1-223d-4ab7-9bf8-24c40a589123',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1230.224492] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 857afeba-8497-43a2-a5f2-438f06b14e01 in Status: SUCCESS [ 1230.225016] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-857afeba-8497-43a2-a5f2-438f06b14e01" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.370503] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f1178ec1-223d-4ab7-9bf8-24c40a589123: rpc.has_security_group_logging(os_id): False [ 1230.388689] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.388911] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.388911] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.389197] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.389293] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.389544] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.389648] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.389711] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.389867] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.389940] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.390037] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 is going to be created. [ 1230.483089] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1230.483320] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1230.483320] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1230.483558] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1230.483745] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1230.496996] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 in Status: IN_PROGRESS for 2s [ 1231.117513] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e42bc2-4203-42a4-85a6-b34ec02b298e in Status: SUCCESS [ 1231.117736] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e42bc2-4203-42a4-85a6-b34ec02b298e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.117897] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e42bc2-4203-42a4-85a6-b34ec02b298e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.118132] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e42bc2-4203-42a4-85a6-b34ec02b298e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.118324] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.118441] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.118506] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.118656] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.118734] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.118817] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e42bc2-4203-42a4-85a6-b34ec02b298e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.118922] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('16e42bc2-4203-42a4-85a6-b34ec02b298e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.622062] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('16e42bc2-4203-42a4-85a6-b34ec02b298e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.123519] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 16e42bc2-4203-42a4-85a6-b34ec02b298e: rpc.has_security_group_logging(os_id): False [ 1232.143116] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.143250] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.143313] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.143723] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.143849] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.144165] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.144279] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.144344] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.144630] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.144630] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.144716] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 16e42bc2-4203-42a4-85a6-b34ec02b298e is going to be created. [ 1232.212217] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.212471] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.212471] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.212697] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.212893] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.230637] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16e42bc2-4203-42a4-85a6-b34ec02b298e in Status: IN_PROGRESS for 2s [ 1232.511050] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 in Status: SUCCESS [ 1232.511050] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.556672] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1232.556901] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1234.242447] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 16e42bc2-4203-42a4-85a6-b34ec02b298e in Status: SUCCESS [ 1234.242745] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-16e42bc2-4203-42a4-85a6-b34ec02b298e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1237.557976] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1237.558342] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1239.979670] env[66502]: INFO networking_nsxv3.common.synchronization [req-67746978-b7a7-400c-85b7-792be3b817e9 req-7581eca4-e246-4b4c-9fbe-06c3250dd8fb tempest-AttachInterfacesTestJSON-1531294335 tempest-AttachInterfacesTestJSON-1531294335-project-member] Enqueued Resource ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 with Priority: HIGHEST for action security_group_members [ 1239.982537] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 with Priority: HIGHEST for action security_group_members [ 1239.982938] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1178ec1-223d-4ab7-9bf8-24c40a589123 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.983209] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.983209] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.983399] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.983806] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.983959] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.984054] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.984245] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.984346] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.984447] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f1178ec1-223d-4ab7-9bf8-24c40a589123',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.330743] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-584 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.330957] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-584" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.331095] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-584" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.331406] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-584" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.331671] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.331843] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.331966] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.332191] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.332334] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.332571] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1240.332684] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1240.332875] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1240.332924] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1240.333046] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1240.333154] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1240.333279] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1240.356158] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1240.356428] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1240.356506] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1240.356670] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-584" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.356986] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-18195196-b6a9-4653-b517-5b57012dafce taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.357188] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-18195196-b6a9-4653-b517-5b57012dafce" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.357303] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-18195196-b6a9-4653-b517-5b57012dafce" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.357657] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-18195196-b6a9-4653-b517-5b57012dafce" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.357816] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18195196-b6a9-4653-b517-5b57012dafce',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.491629] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f1178ec1-223d-4ab7-9bf8-24c40a589123',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.860783] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.861031] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.861127] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.861486] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.861634] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.861789] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Segment Port 18195196-b6a9-4653-b517-5b57012dafce not found, creating... [ 1240.862072] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.862240] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.862363] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.862578] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.862713] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.862992] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.863161] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.863274] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.863477] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.863613] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.863766] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 18195196-b6a9-4653-b517-5b57012dafce is going to be created. [ 1240.885097] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.885298] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.885421] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.885721] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.885950] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.886214] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-18195196-b6a9-4653-b517-5b57012dafce" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.993987] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f1178ec1-223d-4ab7-9bf8-24c40a589123',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.497532] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.497532] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.497532] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.497532] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.497532] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.497532] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 is going to be updated. [ 1241.528132] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.528332] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.528332] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.528537] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.528682] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1241.537613] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 in Status: IN_PROGRESS for 2s [ 1241.582253] env[66502]: INFO networking_nsxv3.common.synchronization [req-67746978-b7a7-400c-85b7-792be3b817e9 req-fd09238d-1f58-47f6-88c6-645df457eb49 service nova] Enqueued Resource ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 with Priority: HIGHEST for action security_group_rules [ 1241.582536] env[66502]: INFO networking_nsxv3.common.synchronization [req-67746978-b7a7-400c-85b7-792be3b817e9 req-fd09238d-1f58-47f6-88c6-645df457eb49 service nova] Enqueued Resource ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 with Priority: HIGHEST for action security_group_members [ 1241.582699] env[66502]: INFO networking_nsxv3.common.synchronization [req-67746978-b7a7-400c-85b7-792be3b817e9 req-fd09238d-1f58-47f6-88c6-645df457eb49 service nova] Enqueued Resource ID: 18195196-b6a9-4653-b517-5b57012dafce with Priority: HIGHEST for action port [ 1241.583280] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 with Priority: HIGHEST for action security_group_rules [ 1241.583370] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 with Priority: HIGHEST for action security_group_members [ 1241.583468] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18195196-b6a9-4653-b517-5b57012dafce with Priority: HIGHEST for action port [ 1241.583747] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f1178ec1-223d-4ab7-9bf8-24c40a589123 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.583894] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.583937] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.584141] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.584216] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f1178ec1-223d-4ab7-9bf8-24c40a589123',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1241.585026] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1178ec1-223d-4ab7-9bf8-24c40a589123 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.585123] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.585683] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-18195196-b6a9-4653-b517-5b57012dafce taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1241.585809] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18195196-b6a9-4653-b517-5b57012dafce" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1241.585853] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18195196-b6a9-4653-b517-5b57012dafce" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1241.586043] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18195196-b6a9-4653-b517-5b57012dafce" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1241.586128] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18195196-b6a9-4653-b517-5b57012dafce',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1242.088269] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1178ec1-223d-4ab7-9bf8-24c40a589123 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.088563] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.088659] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 18195196-b6a9-4653-b517-5b57012dafce with status ACTIVE [ 1242.088765] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.088886] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.088970] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.089172] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.089264] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.089473] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.089575] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.089635] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.089788] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.089864] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.090062] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.090169] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.090286] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.090366] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.090439] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.090814] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 18195196-b6a9-4653-b517-5b57012dafce is going to be updated. [ 1242.113089] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1242.113251] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1242.113310] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1242.113524] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1242.113693] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1242.113881] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18195196-b6a9-4653-b517-5b57012dafce" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.547699] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 in Status: SUCCESS [ 1243.548066] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.548137] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.548383] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.548568] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1243.548684] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1243.548750] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1243.548897] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1243.548977] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1243.549085] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f1178ec1-223d-4ab7-9bf8-24c40a589123',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.052062] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f1178ec1-223d-4ab7-9bf8-24c40a589123',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1244.554232] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f1178ec1-223d-4ab7-9bf8-24c40a589123',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.056344] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.056513] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.056586] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.056810] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.056949] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.057074] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 is going to be updated. [ 1245.086918] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.087153] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.087153] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.087342] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.087514] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.097331] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 in Status: IN_PROGRESS for 2s [ 1246.584868] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1246.585217] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1246.794051] env[66502]: INFO networking_nsxv3.common.synchronization [req-e81f8e63-e281-4dd4-8594-a77cd39169ed req-06a35030-7090-4b68-bc97-025e4656a5ef tempest-AttachVolumeNegativeTest-686526601 tempest-AttachVolumeNegativeTest-686526601-project-member] Enqueued Resource ID: bf700520-a5f6-400c-a90d-a385e198aebe with Priority: HIGHEST for action security_group_members [ 1246.794245] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf700520-a5f6-400c-a90d-a385e198aebe with Priority: HIGHEST for action security_group_members [ 1246.794557] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-bf700520-a5f6-400c-a90d-a385e198aebe taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.794673] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-bf700520-a5f6-400c-a90d-a385e198aebe" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.794740] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-bf700520-a5f6-400c-a90d-a385e198aebe" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.794927] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-bf700520-a5f6-400c-a90d-a385e198aebe" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.795096] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.795702] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.795702] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.795702] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.795702] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.795702] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('bf700520-a5f6-400c-a90d-a385e198aebe',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.108673] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 in Status: SUCCESS [ 1247.108936] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.109119] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.109350] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.109562] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.109682] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.109796] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.109915] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.109991] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.110092] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.110185] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f1178ec1-223d-4ab7-9bf8-24c40a589123',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.298602] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.298810] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.298862] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.299259] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.299383] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.299642] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.299760] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.299814] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.299980] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.300074] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.300162] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf700520-a5f6-400c-a90d-a385e198aebe is going to be updated. [ 1247.330026] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.330237] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.330237] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.330465] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.330680] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.340054] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf700520-a5f6-400c-a90d-a385e198aebe in Status: IN_PROGRESS for 2s [ 1247.613120] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f1178ec1-223d-4ab7-9bf8-24c40a589123',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.116239] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f1178ec1-223d-4ab7-9bf8-24c40a589123: rpc.has_security_group_logging(os_id): False [ 1248.134745] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.135035] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.135035] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.135255] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.135307] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.135780] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.135965] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.136050] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.136213] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.136292] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.136379] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 is going to be updated. [ 1248.197865] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.198033] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.198110] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.198367] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.198540] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.210963] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 in Status: IN_PROGRESS for 2s [ 1249.043425] env[66502]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1249.043425] env[66502]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] NSXv3 Agent Agent loop - iteration:3 started [ 1249.350186] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: bf700520-a5f6-400c-a90d-a385e198aebe in Status: SUCCESS [ 1249.350395] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: bf700520-a5f6-400c-a90d-a385e198aebe deletion is rescheduled due to dependency. [ 1249.350462] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-bf700520-a5f6-400c-a90d-a385e198aebe" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.226938] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 in Status: SUCCESS [ 1250.227412] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.569366] env[66502]: INFO networking_nsxv3.common.synchronization [None req-6538dccc-8d55-4525-86f1-4732b626144f tempest-AttachInterfacesTestJSON-1531294335 tempest-AttachInterfacesTestJSON-1531294335-project-member] Enqueued Resource ID: 3f796883-7322-4113-bfa9-5a64b4903a46 with Priority: HIGHEST for action security_group_members [ 1250.570177] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f796883-7322-4113-bfa9-5a64b4903a46 with Priority: HIGHEST for action security_group_members [ 1250.570487] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f796883-7322-4113-bfa9-5a64b4903a46 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.570610] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.570676] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.570875] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.571319] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1250.572641] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1250.573021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1250.573021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1250.573021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1250.573144] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f796883-7322-4113-bfa9-5a64b4903a46',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.075443] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.075680] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.075757] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.075993] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.076178] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.076388] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.076568] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.076683] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.076861] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.076983] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.077083] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f796883-7322-4113-bfa9-5a64b4903a46 is going to be updated. [ 1251.102419] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.102669] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.102669] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.102876] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.103059] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.115434] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f796883-7322-4113-bfa9-5a64b4903a46 in Status: IN_PROGRESS for 2s [ 1253.128415] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f796883-7322-4113-bfa9-5a64b4903a46 in Status: SUCCESS [ 1253.128785] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f796883-7322-4113-bfa9-5a64b4903a46 deletion is rescheduled due to dependency. [ 1253.128785] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1255.571389] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1255.571824] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1260.572727] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1260.572727] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1263.296671] env[66502]: INFO networking_nsxv3.common.synchronization [req-cccde381-d055-4109-b852-e2208ea589d9 req-5e9e3d98-a156-4c86-8ffa-00fcdc89e2b4 tempest-ServerActionsTestJSON-2133613622 tempest-ServerActionsTestJSON-2133613622-project-member] Enqueued Resource ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 with Priority: HIGHEST for action security_group_members [ 1263.297489] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 with Priority: HIGHEST for action security_group_members [ 1263.297893] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.298066] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.298167] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.298414] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.298641] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.298786] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.298869] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.299084] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.299203] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.299329] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8ab1d50c-f5a6-4aaf-829b-d0cfdf164722',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.801598] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.801872] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.801872] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.802108] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.802230] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.802475] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.802587] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.802672] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.802850] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.802940] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.803046] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 is going to be updated. [ 1263.834262] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.834506] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.834506] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.834768] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.834939] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.843226] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 in Status: IN_PROGRESS for 2s [ 1265.856912] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 in Status: SUCCESS [ 1265.857341] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 deletion is rescheduled due to dependency. [ 1265.857341] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.289709] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-584 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.289709] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-584" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.289709] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-584" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.290129] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-584" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.290364] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.290542] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.290662] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.290881] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.291185] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.291444] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1267.291562] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1267.291664] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1267.291898] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1267.292040] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1267.292153] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1267.292287] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1267.316618] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1267.316808] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1267.316924] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1267.317112] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-584" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.317428] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-82ed06f9-717d-48e8-b2c4-409804640833 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.317599] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-82ed06f9-717d-48e8-b2c4-409804640833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.317719] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-82ed06f9-717d-48e8-b2c4-409804640833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.318070] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-82ed06f9-717d-48e8-b2c4-409804640833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.318219] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82ed06f9-717d-48e8-b2c4-409804640833',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.822343] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.822743] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.822878] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.823288] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.823449] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.823607] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port 82ed06f9-717d-48e8-b2c4-409804640833 not found, creating... [ 1267.823884] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.824083] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.824212] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.824438] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.824575] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.824873] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.825043] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.825162] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.825371] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.825507] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.825645] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: 82ed06f9-717d-48e8-b2c4-409804640833 is going to be created. [ 1267.846648] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.846861] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.846988] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.847372] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.847611] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.847864] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-82ed06f9-717d-48e8-b2c4-409804640833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.298354] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1268.298853] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1268.546794] env[66502]: INFO networking_nsxv3.common.synchronization [req-2c513cc5-5d68-4f21-b3da-891c29360f7e req-fbac5216-d02d-4709-8204-c53270c9aab4 service nova] Enqueued Resource ID: 3f796883-7322-4113-bfa9-5a64b4903a46 with Priority: HIGHEST for action security_group_rules [ 1268.546794] env[66502]: INFO networking_nsxv3.common.synchronization [req-2c513cc5-5d68-4f21-b3da-891c29360f7e req-fbac5216-d02d-4709-8204-c53270c9aab4 service nova] Enqueued Resource ID: 3f796883-7322-4113-bfa9-5a64b4903a46 with Priority: HIGHEST for action security_group_members [ 1268.546794] env[66502]: INFO networking_nsxv3.common.synchronization [req-2c513cc5-5d68-4f21-b3da-891c29360f7e req-fbac5216-d02d-4709-8204-c53270c9aab4 service nova] Enqueued Resource ID: 82ed06f9-717d-48e8-b2c4-409804640833 with Priority: HIGHEST for action port [ 1268.546794] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f796883-7322-4113-bfa9-5a64b4903a46 with Priority: HIGHEST for action security_group_rules [ 1268.546794] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f796883-7322-4113-bfa9-5a64b4903a46 with Priority: HIGHEST for action security_group_members [ 1268.546794] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82ed06f9-717d-48e8-b2c4-409804640833 with Priority: HIGHEST for action port [ 1268.546794] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f796883-7322-4113-bfa9-5a64b4903a46 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.546794] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.546794] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.548064] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.548155] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f796883-7322-4113-bfa9-5a64b4903a46',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.549443] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f796883-7322-4113-bfa9-5a64b4903a46 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.549560] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.549638] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.549856] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.550030] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.550146] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.551708] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.551708] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.551708] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.551708] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f796883-7322-4113-bfa9-5a64b4903a46',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1268.554695] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-82ed06f9-717d-48e8-b2c4-409804640833 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.554824] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82ed06f9-717d-48e8-b2c4-409804640833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.554923] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82ed06f9-717d-48e8-b2c4-409804640833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.555108] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82ed06f9-717d-48e8-b2c4-409804640833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.555188] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82ed06f9-717d-48e8-b2c4-409804640833',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.057168] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f796883-7322-4113-bfa9-5a64b4903a46 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.057168] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.057168] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3f796883-7322-4113-bfa9-5a64b4903a46',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1269.058017] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 82ed06f9-717d-48e8-b2c4-409804640833 with status ACTIVE [ 1269.058346] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.058346] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.058490] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.058597] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.058679] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.058998] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.058998] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.058998] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.059159] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.059239] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.059949] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.059949] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.059949] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.059949] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.059949] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.060303] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 82ed06f9-717d-48e8-b2c4-409804640833 is going to be updated. [ 1269.082230] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1269.082384] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1269.082384] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1269.082560] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1269.082695] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.082861] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82ed06f9-717d-48e8-b2c4-409804640833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1269.562070] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3f796883-7322-4113-bfa9-5a64b4903a46',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.064355] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.064641] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.064641] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.064743] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.064817] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.064927] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f796883-7322-4113-bfa9-5a64b4903a46 is going to be updated. [ 1270.099857] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.100139] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.100139] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.100287] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.100431] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.109233] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f796883-7322-4113-bfa9-5a64b4903a46 in Status: IN_PROGRESS for 2s [ 1272.124452] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f796883-7322-4113-bfa9-5a64b4903a46 in Status: SUCCESS [ 1272.124452] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.124452] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.124452] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.124452] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.124452] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.125185] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.125185] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.125185] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.125185] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.125185] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3f796883-7322-4113-bfa9-5a64b4903a46',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1272.627085] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f796883-7322-4113-bfa9-5a64b4903a46 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.627271] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.627329] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.627647] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.627728] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.627795] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.627868] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.628021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.628114] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.628203] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.628346] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f796883-7322-4113-bfa9-5a64b4903a46 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.628438] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.628497] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.628644] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.628782] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.628940] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.628991] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.629097] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.629168] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.629248] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.629336] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3f796883-7322-4113-bfa9-5a64b4903a46',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1273.132126] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3f796883-7322-4113-bfa9-5a64b4903a46: rpc.has_security_group_logging(os_id): False [ 1273.151052] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.151236] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.151331] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.151586] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.152502] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.152502] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.152502] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.152502] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.152502] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.152502] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.152860] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.152860] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.152860] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.153036] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.153110] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.153393] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.153548] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.153639] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.153891] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.153998] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.154113] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f796883-7322-4113-bfa9-5a64b4903a46 is going to be updated. [ 1273.217191] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1273.217432] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1273.217432] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1273.217595] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1273.217976] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1273.230692] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f796883-7322-4113-bfa9-5a64b4903a46 in Status: IN_PROGRESS for 2s [ 1273.547044] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1273.547180] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1275.246615] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f796883-7322-4113-bfa9-5a64b4903a46 in Status: SUCCESS [ 1275.247162] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1278.547884] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1278.548220] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1280.027119] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-458 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.027499] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-458" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.027499] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-458" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.027626] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-458" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.027918] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.028107] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.028227] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.028519] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.028733] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.028977] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1280.029108] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1280.029226] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1280.029334] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1280.029474] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1280.029627] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1280.029766] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1280.054484] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1280.054774] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1280.054952] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1280.055157] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-458" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.055490] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-367342aa-9a14-4b9c-a8ff-41daf9d9feda taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.055653] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-367342aa-9a14-4b9c-a8ff-41daf9d9feda" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.055771] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-367342aa-9a14-4b9c-a8ff-41daf9d9feda" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.056054] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-367342aa-9a14-4b9c-a8ff-41daf9d9feda" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.056189] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('367342aa-9a14-4b9c-a8ff-41daf9d9feda',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1280.558259] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.558500] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.558638] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.558927] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.559090] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.559378] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.559534] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.559648] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.559867] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.560097] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.560363] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.560510] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.560623] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.560827] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.560957] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.561109] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 367342aa-9a14-4b9c-a8ff-41daf9d9feda is going to be updated. [ 1280.582716] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1280.582997] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1280.583089] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1280.583357] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1280.583548] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1280.583762] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-367342aa-9a14-4b9c-a8ff-41daf9d9feda" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.282304] env[66502]: INFO networking_nsxv3.common.synchronization [req-d3a319d3-3b6f-4e49-84e4-80e9a32a46da req-75774abb-117d-4d2c-bf1e-790f313135bf service nova] Enqueued Resource ID: a5eea73e-9fb6-401e-a5a6-756487d3d58d with Priority: HIGHEST for action security_group_rules [ 1281.282632] env[66502]: INFO networking_nsxv3.common.synchronization [req-d3a319d3-3b6f-4e49-84e4-80e9a32a46da req-75774abb-117d-4d2c-bf1e-790f313135bf service nova] Enqueued Resource ID: a5eea73e-9fb6-401e-a5a6-756487d3d58d with Priority: HIGHEST for action security_group_members [ 1281.282632] env[66502]: INFO networking_nsxv3.common.synchronization [req-d3a319d3-3b6f-4e49-84e4-80e9a32a46da req-75774abb-117d-4d2c-bf1e-790f313135bf service nova] Enqueued Resource ID: 367342aa-9a14-4b9c-a8ff-41daf9d9feda with Priority: HIGHEST for action port [ 1281.283229] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5eea73e-9fb6-401e-a5a6-756487d3d58d with Priority: HIGHEST for action security_group_rules [ 1281.283326] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5eea73e-9fb6-401e-a5a6-756487d3d58d with Priority: HIGHEST for action security_group_members [ 1281.283422] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 367342aa-9a14-4b9c-a8ff-41daf9d9feda with Priority: HIGHEST for action port [ 1281.283699] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5eea73e-9fb6-401e-a5a6-756487d3d58d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.283819] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5eea73e-9fb6-401e-a5a6-756487d3d58d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.283928] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5eea73e-9fb6-401e-a5a6-756487d3d58d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.284739] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5eea73e-9fb6-401e-a5a6-756487d3d58d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.284829] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5eea73e-9fb6-401e-a5a6-756487d3d58d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.287322] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5eea73e-9fb6-401e-a5a6-756487d3d58d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.287428] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5eea73e-9fb6-401e-a5a6-756487d3d58d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.287500] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5eea73e-9fb6-401e-a5a6-756487d3d58d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.287690] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5eea73e-9fb6-401e-a5a6-756487d3d58d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.288091] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.288091] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.288091] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.288223] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.288223] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.288302] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5eea73e-9fb6-401e-a5a6-756487d3d58d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.292324] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-367342aa-9a14-4b9c-a8ff-41daf9d9feda taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.292440] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-367342aa-9a14-4b9c-a8ff-41daf9d9feda" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.292496] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-367342aa-9a14-4b9c-a8ff-41daf9d9feda" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.293229] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-367342aa-9a14-4b9c-a8ff-41daf9d9feda" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.293229] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('367342aa-9a14-4b9c-a8ff-41daf9d9feda',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.790753] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5eea73e-9fb6-401e-a5a6-756487d3d58d taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.790753] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5eea73e-9fb6-401e-a5a6-756487d3d58d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.796402] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a5eea73e-9fb6-401e-a5a6-756487d3d58d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1281.797375] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 367342aa-9a14-4b9c-a8ff-41daf9d9feda with status ACTIVE [ 1281.797572] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.797689] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.797751] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.797962] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.798058] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.798233] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.798328] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.798381] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.798661] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.798735] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.798913] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.799013] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.799072] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.799346] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.799575] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.799575] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 367342aa-9a14-4b9c-a8ff-41daf9d9feda is going to be updated. [ 1281.826263] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1281.826263] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1281.826263] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1281.826263] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1281.826263] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1281.826263] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-367342aa-9a14-4b9c-a8ff-41daf9d9feda" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.301622] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a5eea73e-9fb6-401e-a5a6-756487d3d58d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1282.804601] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.804779] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.804841] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.805138] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.805178] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.805257] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5eea73e-9fb6-401e-a5a6-756487d3d58d is going to be updated. [ 1282.836999] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1282.837222] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1282.837270] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1282.837477] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1282.837617] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1282.847447] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5eea73e-9fb6-401e-a5a6-756487d3d58d in Status: IN_PROGRESS for 2s [ 1283.577249] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-584 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.577551] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-584" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.577589] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-584" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.577921] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-584" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.578227] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.578440] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.578584] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.578826] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.578996] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.579255] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1283.579396] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1283.579578] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1283.579706] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1283.579860] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1283.579947] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1283.580093] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1283.598150] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1283.598335] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.018 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1283.598454] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1283.598620] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-584" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1283.598925] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-82ed06f9-717d-48e8-b2c4-409804640833 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1283.599114] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-82ed06f9-717d-48e8-b2c4-409804640833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1283.599232] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-82ed06f9-717d-48e8-b2c4-409804640833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1283.599479] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-82ed06f9-717d-48e8-b2c4-409804640833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1283.599612] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82ed06f9-717d-48e8-b2c4-409804640833',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.102192] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.102420] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.102546] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.102824] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.102967] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.103283] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.103439] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.103555] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.103763] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.103894] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.104194] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.104348] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.104460] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.104659] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.104788] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.104925] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: 82ed06f9-717d-48e8-b2c4-409804640833 is going to be updated. [ 1284.125423] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.125647] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.125778] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.126068] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.126283] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.126524] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-82ed06f9-717d-48e8-b2c4-409804640833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.834718] env[66502]: INFO networking_nsxv3.common.synchronization [req-16b1ccf5-a229-40f4-ab19-02155b9f1af4 req-11aee72d-5817-4a87-91be-0316535828f2 service nova] Enqueued Resource ID: 3f796883-7322-4113-bfa9-5a64b4903a46 with Priority: HIGHEST for action security_group_rules [ 1284.834978] env[66502]: INFO networking_nsxv3.common.synchronization [req-16b1ccf5-a229-40f4-ab19-02155b9f1af4 req-11aee72d-5817-4a87-91be-0316535828f2 service nova] Enqueued Resource ID: 3f796883-7322-4113-bfa9-5a64b4903a46 with Priority: HIGHEST for action security_group_members [ 1284.834978] env[66502]: INFO networking_nsxv3.common.synchronization [req-16b1ccf5-a229-40f4-ab19-02155b9f1af4 req-11aee72d-5817-4a87-91be-0316535828f2 service nova] Enqueued Resource ID: 82ed06f9-717d-48e8-b2c4-409804640833 with Priority: HIGHEST for action port [ 1284.835498] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f796883-7322-4113-bfa9-5a64b4903a46 with Priority: HIGHEST for action security_group_rules [ 1284.835648] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f796883-7322-4113-bfa9-5a64b4903a46 with Priority: HIGHEST for action security_group_members [ 1284.835722] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 82ed06f9-717d-48e8-b2c4-409804640833 with Priority: HIGHEST for action port [ 1284.835986] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3f796883-7322-4113-bfa9-5a64b4903a46 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.836118] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.836189] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.836385] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.836468] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3f796883-7322-4113-bfa9-5a64b4903a46',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.837317] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f796883-7322-4113-bfa9-5a64b4903a46 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.837890] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.837890] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.837890] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.837890] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.837890] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.837890] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.838198] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.838198] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.838198] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f796883-7322-4113-bfa9-5a64b4903a46',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.838886] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-82ed06f9-717d-48e8-b2c4-409804640833 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.838987] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-82ed06f9-717d-48e8-b2c4-409804640833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.839400] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-82ed06f9-717d-48e8-b2c4-409804640833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.839400] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-82ed06f9-717d-48e8-b2c4-409804640833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.839400] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('82ed06f9-717d-48e8-b2c4-409804640833',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1284.858504] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5eea73e-9fb6-401e-a5a6-756487d3d58d in Status: SUCCESS [ 1284.858721] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5eea73e-9fb6-401e-a5a6-756487d3d58d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.858875] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5eea73e-9fb6-401e-a5a6-756487d3d58d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.859119] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5eea73e-9fb6-401e-a5a6-756487d3d58d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.859331] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1284.859457] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1284.859516] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1284.859671] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1284.859753] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.859841] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5eea73e-9fb6-401e-a5a6-756487d3d58d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.859932] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a5eea73e-9fb6-401e-a5a6-756487d3d58d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.340830] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f796883-7322-4113-bfa9-5a64b4903a46 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.341037] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.341269] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3f796883-7322-4113-bfa9-5a64b4903a46',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.342356] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 82ed06f9-717d-48e8-b2c4-409804640833 with status ACTIVE [ 1285.343033] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.343033] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.343033] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.343259] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.343259] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.343474] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.343604] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.343687] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.343905] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.344037] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.344259] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.344395] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.344471] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.344693] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.344745] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.344837] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 82ed06f9-717d-48e8-b2c4-409804640833 is going to be updated. [ 1285.362366] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a5eea73e-9fb6-401e-a5a6-756487d3d58d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.367144] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.367309] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.367385] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.367866] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.367866] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.368086] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-82ed06f9-717d-48e8-b2c4-409804640833" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.847790] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3f796883-7322-4113-bfa9-5a64b4903a46',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1285.864571] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a5eea73e-9fb6-401e-a5a6-756487d3d58d: rpc.has_security_group_logging(os_id): False [ 1285.893219] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.893441] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.893441] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.893625] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.893776] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.894037] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.894162] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.894244] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.894436] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.894545] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.894648] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5eea73e-9fb6-401e-a5a6-756487d3d58d is going to be updated. [ 1285.962375] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1285.962375] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1285.962375] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1285.962375] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1285.962375] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1285.976547] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5eea73e-9fb6-401e-a5a6-756487d3d58d in Status: IN_PROGRESS for 2s [ 1286.350417] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.350631] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.350631] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.350856] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.350946] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.351056] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f796883-7322-4113-bfa9-5a64b4903a46 is going to be updated. [ 1286.379227] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1286.379423] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1286.379423] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1286.379630] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1286.379778] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1286.389554] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f796883-7322-4113-bfa9-5a64b4903a46 in Status: IN_PROGRESS for 2s [ 1287.992552] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5eea73e-9fb6-401e-a5a6-756487d3d58d in Status: SUCCESS [ 1287.992552] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5eea73e-9fb6-401e-a5a6-756487d3d58d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.401563] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f796883-7322-4113-bfa9-5a64b4903a46 in Status: SUCCESS [ 1288.401892] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.402248] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.402576] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.402869] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.403110] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.403266] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.403515] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.403621] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.403746] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.403866] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3f796883-7322-4113-bfa9-5a64b4903a46',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.906277] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f796883-7322-4113-bfa9-5a64b4903a46 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.906521] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.906521] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.906717] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.906887] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.906988] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.907062] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.907215] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.907305] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.907389] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.907533] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f796883-7322-4113-bfa9-5a64b4903a46 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.907624] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.907681] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.907818] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.907952] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.908060] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.908115] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.908248] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.908319] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.908396] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.908480] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3f796883-7322-4113-bfa9-5a64b4903a46',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.411097] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3f796883-7322-4113-bfa9-5a64b4903a46: rpc.has_security_group_logging(os_id): False [ 1289.430951] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.431233] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.431233] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.431378] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.431468] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.431687] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.431786] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.431849] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.431993] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.432148] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.432281] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.432373] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.432430] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.432566] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.432638] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.432815] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.432896] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.432960] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.433111] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.433185] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.433270] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3f796883-7322-4113-bfa9-5a64b4903a46 is going to be updated. [ 1289.495372] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.495690] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.495690] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.495773] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.495908] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.508473] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f796883-7322-4113-bfa9-5a64b4903a46 in Status: IN_PROGRESS for 2s [ 1289.836314] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1289.836457] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1291.527480] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3f796883-7322-4113-bfa9-5a64b4903a46 in Status: SUCCESS [ 1291.527727] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.632040] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock network-427 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.632040] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "network-427" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.632040] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "network-427" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.632426] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "network-427" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.632794] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.633055] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.633189] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.633381] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.633525] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.633731] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1291.633841] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1291.633995] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1291.634196] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1291.634329] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1291.634439] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1291.634572] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1291.654995] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1291.655285] env[66502]: DEBUG dogpile.cache.region [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1291.655376] env[66502]: DEBUG dogpile.lock [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1291.655485] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "network-427" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1291.655822] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock port-8376241b-f2d7-4f78-a4fb-023587861732 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1291.655997] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "port-8376241b-f2d7-4f78-a4fb-023587861732" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1291.656132] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "port-8376241b-f2d7-4f78-a4fb-023587861732" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1291.656416] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "port-8376241b-f2d7-4f78-a4fb-023587861732" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1291.656556] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8376241b-f2d7-4f78-a4fb-023587861732',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.158872] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.159216] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.159374] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.159626] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.159773] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.160087] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.160344] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.160451] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.160690] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.160900] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.161215] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.161378] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.161497] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.161707] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.161891] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.162073] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Resource: SegmentPort with ID: 8376241b-f2d7-4f78-a4fb-023587861732 is going to be updated. [ 1292.184855] env[66502]: DEBUG networking_nsxv3.common.locking [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.185115] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.185249] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.185556] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.185781] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.186047] env[66502]: DEBUG oslo_concurrency.lockutils [None req-ff779892-9ead-4264-82d4-556ddbe965d6 None None] Releasing lock "port-8376241b-f2d7-4f78-a4fb-023587861732" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.918650] env[66502]: INFO networking_nsxv3.common.synchronization [req-290034dd-8ead-4aef-8e21-b86d0a498434 req-38f4aa82-df38-4a55-81aa-1506d79270c5 service nova] Enqueued Resource ID: 670eb61a-b688-45b2-9400-64232c7b8af0 with Priority: HIGHEST for action security_group_rules [ 1292.918954] env[66502]: INFO networking_nsxv3.common.synchronization [req-290034dd-8ead-4aef-8e21-b86d0a498434 req-38f4aa82-df38-4a55-81aa-1506d79270c5 service nova] Enqueued Resource ID: 670eb61a-b688-45b2-9400-64232c7b8af0 with Priority: HIGHEST for action security_group_members [ 1292.918954] env[66502]: INFO networking_nsxv3.common.synchronization [req-290034dd-8ead-4aef-8e21-b86d0a498434 req-38f4aa82-df38-4a55-81aa-1506d79270c5 service nova] Enqueued Resource ID: 8376241b-f2d7-4f78-a4fb-023587861732 with Priority: HIGHEST for action port [ 1292.919678] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 670eb61a-b688-45b2-9400-64232c7b8af0 with Priority: HIGHEST for action security_group_rules [ 1292.919851] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 670eb61a-b688-45b2-9400-64232c7b8af0 with Priority: HIGHEST for action security_group_members [ 1292.919950] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8376241b-f2d7-4f78-a4fb-023587861732 with Priority: HIGHEST for action port [ 1292.920347] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-670eb61a-b688-45b2-9400-64232c7b8af0 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.920482] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.920543] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.920752] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.920878] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('670eb61a-b688-45b2-9400-64232c7b8af0',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.922127] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-670eb61a-b688-45b2-9400-64232c7b8af0 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.922255] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.922364] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.922554] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.922713] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.922812] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.922875] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.923036] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.923129] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.923393] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('670eb61a-b688-45b2-9400-64232c7b8af0',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.924571] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-8376241b-f2d7-4f78-a4fb-023587861732 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.924710] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8376241b-f2d7-4f78-a4fb-023587861732" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.924780] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8376241b-f2d7-4f78-a4fb-023587861732" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.924937] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8376241b-f2d7-4f78-a4fb-023587861732" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.925021] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8376241b-f2d7-4f78-a4fb-023587861732',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.426890] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-670eb61a-b688-45b2-9400-64232c7b8af0 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.427165] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.427362] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('670eb61a-b688-45b2-9400-64232c7b8af0',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.428529] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8376241b-f2d7-4f78-a4fb-023587861732 with status ACTIVE [ 1293.428529] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.428709] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.428709] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.428997] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.429141] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.429284] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.429384] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.429488] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.429595] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.429696] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.429886] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.430020] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.430123] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.430207] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.430280] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.430418] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8376241b-f2d7-4f78-a4fb-023587861732 is going to be updated. [ 1293.456462] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.456704] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.456704] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.456873] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.457019] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.457184] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8376241b-f2d7-4f78-a4fb-023587861732" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.933180] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('670eb61a-b688-45b2-9400-64232c7b8af0',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1294.436638] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.436827] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.436919] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.437182] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.437383] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.437383] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 670eb61a-b688-45b2-9400-64232c7b8af0 is going to be updated. [ 1294.472069] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.472374] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.472523] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.472835] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.473083] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1294.485695] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 670eb61a-b688-45b2-9400-64232c7b8af0 in Status: IN_PROGRESS for 2s [ 1294.991034] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1294.991412] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1294.991412] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1294.991498] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1294.991573] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.493964] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1295.997374] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1296.499436] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 670eb61a-b688-45b2-9400-64232c7b8af0 in Status: SUCCESS [ 1296.499657] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.499902] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1296.499989] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1296.500865] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.501093] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.501280] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1296.501396] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1296.501461] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1296.501607] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1296.501687] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.501769] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1296.501857] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('670eb61a-b688-45b2-9400-64232c7b8af0',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.003763] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('670eb61a-b688-45b2-9400-64232c7b8af0',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1297.506120] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 670eb61a-b688-45b2-9400-64232c7b8af0: rpc.has_security_group_logging(os_id): False [ 1297.533806] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.534080] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.534080] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.534414] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.534511] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.534760] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.534889] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.534964] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.535199] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.535273] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.535359] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 670eb61a-b688-45b2-9400-64232c7b8af0 is going to be updated. [ 1297.549971] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.550321] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.550321] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.550513] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.568133] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1297.569090] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.570135] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1297.612883] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.613167] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.613237] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.613582] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.637377] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.639041] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1297.639190] env[66502]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=66502) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1297.639379] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1297.642208] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.642400] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.642512] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.642835] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.643075] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.666017] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 670eb61a-b688-45b2-9400-64232c7b8af0 in Status: IN_PROGRESS for 2s [ 1297.710385] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.710686] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.710686] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.710907] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.712419] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.712660] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1297.833103] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.833391] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.833391] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.833561] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.834070] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.834446] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1297.921432] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1297.921658] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1297.933058] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.933293] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.933293] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.933490] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.933862] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.934235] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:44. [ 1297.934307] env[66502]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'9d226a97-2d69-4706-b98b-565700008c6f', '6768b7ab-f09a-42ec-87a9-9546009ee043', '5988a824-4ff2-477d-8139-5418f9c569e4', 'd9e364d3-a93f-4a56-a513-11d45b81aadf', '4eb2d9d2-95c1-4cee-98cc-8a9106959838', '8ab1d50c-f5a6-4aaf-829b-d0cfdf164722', '857afeba-8497-43a2-a5f2-438f06b14e01', '62257f18-fec2-4d84-abfc-4bb2cbec54bc', 'aba51398-48dc-4f5e-b3cf-1da4130d58fb', 'b069d377-c59c-4f56-8831-a284c29b3f31', '0880fb6e-a350-4602-9874-47125beb1eb3', '14691ab9-6ef7-4499-a5c8-0c1a0b5a8191', 'afe84ec2-d66d-4a72-afc0-223b05dddb60', 'bf700520-a5f6-400c-a90d-a385e198aebe', 'da4454aa-c9b4-48df-a3af-94b687746e31', '6a050294-bf61-423f-b50c-cccbf8fa309f', '9ee12fee-49b0-4d1d-b52d-29888a355e8a', 'e12852c1-7dc2-4ed2-bd34-e396f9f9256d', '8778c764-50b3-4305-af4e-70e2f924392d', 'ee8e701d-05aa-43ae-8307-095303edba0f', 'a5eea73e-9fb6-401e-a5a6-756487d3d58d', '6de9830d-7ae4-42f4-8f89-7bd0093a3ef2', '4dd503d7-4db7-4af2-b850-79a736ef1ddc', 'a469cf90-b952-424a-940b-c195857fb6f2', 'f88da942-4241-46c3-a802-06b5afc96ff7', '0204e1c6-c967-43a4-828f-5c28ecb8f527', 'c6a88e37-d54b-42a9-b5c6-a059d6ab069a', '3f796883-7322-4113-bfa9-5a64b4903a46', 'b96da033-21f1-44bb-a822-a4cb59139771', 'c04d1b14-a58f-4eee-b805-5b75e4c0afc4', '16e42bc2-4203-42a4-85a6-b34ec02b298e', '704e5eab-aa44-4493-8c9a-0b24250e7bea', '670eb61a-b688-45b2-9400-64232c7b8af0', '0bae9bdb-dcb4-4110-bcb0-1b0548a94738', '145e088c-6cef-4e3b-8451-5f708e7f0412', '881e7189-5d27-4efb-b9a3-71f2b26c3add', '4e7cd6e6-d509-47fc-bdc9-e696e3cf8d4f', 'fabd7a28-e5fa-4d14-9bb3-bfd99d170f07', '7421254e-fac2-4232-97e1-1f7373688543', 'f33bcef8-0b06-4301-b08b-ba4a7cd9e47a', 'eeb100e3-e5a7-4d38-a030-42278dbe1366', 'b10a43dc-2d28-4687-a424-05a1ebdfa3c3', '4fcd5f21-1906-475c-9571-24c419ac05d8', 'f1178ec1-223d-4ab7-9bf8-24c40a589123'} {{(pid=66502) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1297.934412] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1297.956412] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1297.956700] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1297.956700] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1297.956823] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1297.956916] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1297.957035] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1297.957105] env[66502]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=66502) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1297.957176] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1298.039532] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1298.039943] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1298.039943] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1298.039943] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1298.041164] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.041479] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1298.041560] env[66502]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=66502) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1298.041624] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1298.041691] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1298.041770] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/44 resources of Type:Security Group Rules [ 1298.041843] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGH for action security_group_rules [ 1298.041923] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6768b7ab-f09a-42ec-87a9-9546009ee043 with Priority: HIGH for action security_group_rules [ 1298.041990] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5988a824-4ff2-477d-8139-5418f9c569e4 with Priority: HIGH for action security_group_rules [ 1298.042056] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d9e364d3-a93f-4a56-a513-11d45b81aadf with Priority: HIGH for action security_group_rules [ 1298.042115] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 with Priority: HIGH for action security_group_rules [ 1298.042210] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 with Priority: HIGH for action security_group_rules [ 1298.042275] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 857afeba-8497-43a2-a5f2-438f06b14e01 with Priority: HIGH for action security_group_rules [ 1298.042333] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 62257f18-fec2-4d84-abfc-4bb2cbec54bc with Priority: HIGH for action security_group_rules [ 1298.042387] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGH for action security_group_rules [ 1298.042446] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b069d377-c59c-4f56-8831-a284c29b3f31 with Priority: HIGH for action security_group_rules [ 1298.042501] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0880fb6e-a350-4602-9874-47125beb1eb3 with Priority: HIGH for action security_group_rules [ 1298.042573] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 with Priority: HIGH for action security_group_rules [ 1298.042632] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: afe84ec2-d66d-4a72-afc0-223b05dddb60 with Priority: HIGH for action security_group_rules [ 1298.042691] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: bf700520-a5f6-400c-a90d-a385e198aebe with Priority: HIGH for action security_group_rules [ 1298.042745] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: da4454aa-c9b4-48df-a3af-94b687746e31 with Priority: HIGH for action security_group_rules [ 1298.042820] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6a050294-bf61-423f-b50c-cccbf8fa309f with Priority: HIGH for action security_group_rules [ 1298.042875] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a with Priority: HIGH for action security_group_rules [ 1298.042941] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: e12852c1-7dc2-4ed2-bd34-e396f9f9256d with Priority: HIGH for action security_group_rules [ 1298.042999] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8778c764-50b3-4305-af4e-70e2f924392d with Priority: HIGH for action security_group_rules [ 1298.043126] env[66502]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ee8e701d-05aa-43ae-8307-095303edba0f with Priority: HIGH for action security_group_rules [ 1298.043200] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1299.682225] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 670eb61a-b688-45b2-9400-64232c7b8af0 in Status: SUCCESS [ 1299.682615] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.598823] env[66502]: INFO networking_nsxv3.common.synchronization [req-8b3d21bf-a2b5-4614-9ac1-b120503c12bf req-7d63bf3d-f820-40ba-b1b8-9927a21f6023 tempest-AttachInterfacesTestJSON-1531294335 tempest-AttachInterfacesTestJSON-1531294335-project-member] Enqueued Resource ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 with Priority: HIGHEST for action security_group_members [ 1302.599023] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 with Priority: HIGHEST for action security_group_members [ 1302.599179] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d226a97-2d69-4706-b98b-565700008c6f with Priority: HIGH for action security_group_rules [ 1302.599313] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5988a824-4ff2-477d-8139-5418f9c569e4 with Priority: HIGH for action security_group_rules [ 1302.599400] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 857afeba-8497-43a2-a5f2-438f06b14e01 with Priority: HIGH for action security_group_rules [ 1302.599498] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da4454aa-c9b4-48df-a3af-94b687746e31 with Priority: HIGH for action security_group_rules [ 1302.599604] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ee8e701d-05aa-43ae-8307-095303edba0f with Priority: HIGH for action security_group_rules [ 1302.599707] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8778c764-50b3-4305-af4e-70e2f924392d with Priority: HIGH for action security_group_rules [ 1302.599791] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e12852c1-7dc2-4ed2-bd34-e396f9f9256d with Priority: HIGH for action security_group_rules [ 1302.599913] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a with Priority: HIGH for action security_group_rules [ 1302.600018] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf700520-a5f6-400c-a90d-a385e198aebe with Priority: HIGH for action security_group_rules [ 1302.600140] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6a050294-bf61-423f-b50c-cccbf8fa309f with Priority: HIGH for action security_group_rules [ 1302.600252] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: afe84ec2-d66d-4a72-afc0-223b05dddb60 with Priority: HIGH for action security_group_rules [ 1302.600326] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 with Priority: HIGH for action security_group_rules [ 1302.600391] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0880fb6e-a350-4602-9874-47125beb1eb3 with Priority: HIGH for action security_group_rules [ 1302.600476] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b069d377-c59c-4f56-8831-a284c29b3f31 with Priority: HIGH for action security_group_rules [ 1302.600563] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb with Priority: HIGH for action security_group_rules [ 1302.600649] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 with Priority: HIGH for action security_group_rules [ 1302.600735] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62257f18-fec2-4d84-abfc-4bb2cbec54bc with Priority: HIGH for action security_group_rules [ 1302.600820] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 with Priority: HIGH for action security_group_rules [ 1302.600919] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6768b7ab-f09a-42ec-87a9-9546009ee043 with Priority: HIGH for action security_group_rules [ 1302.601652] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d9e364d3-a93f-4a56-a513-11d45b81aadf with Priority: HIGH for action security_group_rules [ 1302.602132] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1178ec1-223d-4ab7-9bf8-24c40a589123 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.602360] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.602443] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.602700] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.602954] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.603151] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.603251] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.603505] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.603647] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.603807] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f1178ec1-223d-4ab7-9bf8-24c40a589123',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.605211] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9d226a97-2d69-4706-b98b-565700008c6f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.605376] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.605511] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.605992] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.605992] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9d226a97-2d69-4706-b98b-565700008c6f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.607036] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5988a824-4ff2-477d-8139-5418f9c569e4 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.607212] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5988a824-4ff2-477d-8139-5418f9c569e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.607670] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5988a824-4ff2-477d-8139-5418f9c569e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.607670] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5988a824-4ff2-477d-8139-5418f9c569e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.607670] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5988a824-4ff2-477d-8139-5418f9c569e4',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.608747] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-857afeba-8497-43a2-a5f2-438f06b14e01 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.608915] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-857afeba-8497-43a2-a5f2-438f06b14e01" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.609035] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-857afeba-8497-43a2-a5f2-438f06b14e01" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.609284] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-857afeba-8497-43a2-a5f2-438f06b14e01" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.609415] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('857afeba-8497-43a2-a5f2-438f06b14e01',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.610992] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da4454aa-c9b4-48df-a3af-94b687746e31 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.610992] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.610992] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.611270] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.611270] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da4454aa-c9b4-48df-a3af-94b687746e31',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.612318] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ee8e701d-05aa-43ae-8307-095303edba0f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.612466] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ee8e701d-05aa-43ae-8307-095303edba0f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.612691] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ee8e701d-05aa-43ae-8307-095303edba0f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.612874] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ee8e701d-05aa-43ae-8307-095303edba0f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.612966] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ee8e701d-05aa-43ae-8307-095303edba0f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.614043] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8778c764-50b3-4305-af4e-70e2f924392d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.614493] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.614493] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.614742] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.614742] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8778c764-50b3-4305-af4e-70e2f924392d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.615796] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-e12852c1-7dc2-4ed2-bd34-e396f9f9256d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.615966] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.616094] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.616346] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.616478] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('e12852c1-7dc2-4ed2-bd34-e396f9f9256d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.617654] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9ee12fee-49b0-4d1d-b52d-29888a355e8a taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.617826] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.617910] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.618176] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.618285] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9ee12fee-49b0-4d1d-b52d-29888a355e8a',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.619575] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-bf700520-a5f6-400c-a90d-a385e198aebe taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.619700] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-bf700520-a5f6-400c-a90d-a385e198aebe" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.620257] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-bf700520-a5f6-400c-a90d-a385e198aebe" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.620257] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-bf700520-a5f6-400c-a90d-a385e198aebe" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.620257] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('bf700520-a5f6-400c-a90d-a385e198aebe',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.621863] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6a050294-bf61-423f-b50c-cccbf8fa309f taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.621863] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6a050294-bf61-423f-b50c-cccbf8fa309f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.621863] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6a050294-bf61-423f-b50c-cccbf8fa309f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.621863] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6a050294-bf61-423f-b50c-cccbf8fa309f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.622467] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6a050294-bf61-423f-b50c-cccbf8fa309f',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.623075] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-afe84ec2-d66d-4a72-afc0-223b05dddb60 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.623225] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-afe84ec2-d66d-4a72-afc0-223b05dddb60" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.623338] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-afe84ec2-d66d-4a72-afc0-223b05dddb60" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.623568] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-afe84ec2-d66d-4a72-afc0-223b05dddb60" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.623930] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('afe84ec2-d66d-4a72-afc0-223b05dddb60',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.624674] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.624798] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.624900] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.625580] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.625580] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('14691ab9-6ef7-4499-a5c8-0c1a0b5a8191',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.626209] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0880fb6e-a350-4602-9874-47125beb1eb3 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.626368] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.626731] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.626731] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.626833] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0880fb6e-a350-4602-9874-47125beb1eb3',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.627735] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b069d377-c59c-4f56-8831-a284c29b3f31 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.627907] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b069d377-c59c-4f56-8831-a284c29b3f31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.628061] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b069d377-c59c-4f56-8831-a284c29b3f31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.628164] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b069d377-c59c-4f56-8831-a284c29b3f31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.628265] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b069d377-c59c-4f56-8831-a284c29b3f31',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.629278] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-aba51398-48dc-4f5e-b3cf-1da4130d58fb taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.629449] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.629810] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.629810] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.629926] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('aba51398-48dc-4f5e-b3cf-1da4130d58fb',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.630962] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.630962] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.630962] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.631152] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.631200] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8ab1d50c-f5a6-4aaf-829b-d0cfdf164722',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.632136] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-62257f18-fec2-4d84-abfc-4bb2cbec54bc taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.632305] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-62257f18-fec2-4d84-abfc-4bb2cbec54bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.632405] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-62257f18-fec2-4d84-abfc-4bb2cbec54bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.632639] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-62257f18-fec2-4d84-abfc-4bb2cbec54bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.632763] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('62257f18-fec2-4d84-abfc-4bb2cbec54bc',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.636876] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4eb2d9d2-95c1-4cee-98cc-8a9106959838 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.637095] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.637206] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.637486] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.637673] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4eb2d9d2-95c1-4cee-98cc-8a9106959838',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.638800] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6768b7ab-f09a-42ec-87a9-9546009ee043 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.638971] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6768b7ab-f09a-42ec-87a9-9546009ee043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.639113] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6768b7ab-f09a-42ec-87a9-9546009ee043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.639377] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6768b7ab-f09a-42ec-87a9-9546009ee043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.639502] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6768b7ab-f09a-42ec-87a9-9546009ee043',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.640647] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d9e364d3-a93f-4a56-a513-11d45b81aadf taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.640758] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d9e364d3-a93f-4a56-a513-11d45b81aadf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.640870] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d9e364d3-a93f-4a56-a513-11d45b81aadf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.641161] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d9e364d3-a93f-4a56-a513-11d45b81aadf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.641284] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d9e364d3-a93f-4a56-a513-11d45b81aadf',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1302.679036] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.679036] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.679036] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.679036] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.702203] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.702893] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9d226a97-2d69-4706-b98b-565700008c6f is going to be deleted. [ 1302.757843] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1302.758386] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1302.758943] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1302.759436] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1302.759617] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1302.759898] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9d226a97-2d69-4706-b98b-565700008c6f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.147051] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-857afeba-8497-43a2-a5f2-438f06b14e01 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.147051] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-857afeba-8497-43a2-a5f2-438f06b14e01" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.147051] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-857afeba-8497-43a2-a5f2-438f06b14e01" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.147051] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-857afeba-8497-43a2-a5f2-438f06b14e01" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.147051] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.147051] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.147051] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.147051] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.147051] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.147051] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-857afeba-8497-43a2-a5f2-438f06b14e01" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.147051] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('857afeba-8497-43a2-a5f2-438f06b14e01',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.153157] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f1178ec1-223d-4ab7-9bf8-24c40a589123',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.159993] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-8778c764-50b3-4305-af4e-70e2f924392d taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.160814] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.161030] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.161737] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.163523] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.163523] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.163523] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.163523] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.163523] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.163523] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.163523] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8778c764-50b3-4305-af4e-70e2f924392d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.200025] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.200025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.200025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.200025] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.221299] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.221772] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.239715] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.240181] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.241611] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.245026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.245026] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.245026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.245026] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.245026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.245026] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.245026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.246194] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.246474] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.248639] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.248639] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.248639] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.248639] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.250932] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.251083] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.252716] env[66502]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1303.253228] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.253447] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.254109] env[66502]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1303.254556] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.254688] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.257098] env[66502]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1303.257375] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.257473] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.258125] env[66502]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1303.258502] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.258600] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.259245] env[66502]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1303.259626] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.259715] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.260654] env[66502]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1303.261294] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.261294] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5988a824-4ff2-477d-8139-5418f9c569e4 is going to be deleted. [ 1303.262117] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.262380] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.264058] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.264171] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.287031] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.287031] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9ee12fee-49b0-4d1d-b52d-29888a355e8a is going to be deleted. [ 1303.287677] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.287967] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.319055] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.319055] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8ab1d50c-f5a6-4aaf-829b-d0cfdf164722 is going to be deleted. [ 1303.319683] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.319903] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.331008] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.331219] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.362394] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.362571] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0880fb6e-a350-4602-9874-47125beb1eb3 is going to be deleted. [ 1303.363965] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.364123] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.402561] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.402561] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.416611] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.416768] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6768b7ab-f09a-42ec-87a9-9546009ee043 is going to be deleted. [ 1303.417759] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.417978] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.473064] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.473064] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da4454aa-c9b4-48df-a3af-94b687746e31 is going to be deleted. [ 1303.474278] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.474635] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.476471] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.476658] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.479929] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.480059] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.523948] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.524146] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b069d377-c59c-4f56-8831-a284c29b3f31 is going to be deleted. [ 1303.525466] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.525741] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.539417] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.539417] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.564186] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.564428] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.578765] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.578959] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6a050294-bf61-423f-b50c-cccbf8fa309f is going to be deleted. [ 1303.580011] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.580455] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.648337] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.648750] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: bf700520-a5f6-400c-a90d-a385e198aebe is going to be deleted. [ 1303.649525] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.649859] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.665137] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8778c764-50b3-4305-af4e-70e2f924392d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.668296] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('857afeba-8497-43a2-a5f2-438f06b14e01',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.673552] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f1178ec1-223d-4ab7-9bf8-24c40a589123',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1303.684758] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.684840] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: e12852c1-7dc2-4ed2-bd34-e396f9f9256d is going to be deleted. [ 1303.686495] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.686747] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.689786] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.690103] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.710983] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.711347] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 14691ab9-6ef7-4499-a5c8-0c1a0b5a8191 is going to be deleted. [ 1303.712501] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.712791] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.736952] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.737238] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.769708] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.770312] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.777220] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.777395] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 62257f18-fec2-4d84-abfc-4bb2cbec54bc is going to be deleted. [ 1303.778405] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.778719] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.780815] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.781013] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.843901] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.844100] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ee8e701d-05aa-43ae-8307-095303edba0f is going to be deleted. [ 1303.845175] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.845397] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.892829] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.893075] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.906641] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.906836] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: aba51398-48dc-4f5e-b3cf-1da4130d58fb is going to be deleted. [ 1303.907797] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.908039] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.932076] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.932654] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.934247] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.934399] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: afe84ec2-d66d-4a72-afc0-223b05dddb60 is going to be deleted. [ 1303.935247] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.935459] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.954596] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.954803] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1303.965054] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1303.965248] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4eb2d9d2-95c1-4cee-98cc-8a9106959838 is going to be deleted. [ 1303.966235] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1303.966455] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1303.979304] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1303.979563] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.010977] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.011207] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d9e364d3-a93f-4a56-a513-11d45b81aadf is going to be deleted. [ 1304.012176] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.012476] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.012571] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.012702] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5988a824-4ff2-477d-8139-5418f9c569e4" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.012865] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.013032] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.013114] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.013248] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9ee12fee-49b0-4d1d-b52d-29888a355e8a" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.013878] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.013990] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.014071] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.014193] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8ab1d50c-f5a6-4aaf-829b-d0cfdf164722" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.014323] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.014469] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.014600] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.014727] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0880fb6e-a350-4602-9874-47125beb1eb3" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.014855] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.015021] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.015094] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.015205] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6768b7ab-f09a-42ec-87a9-9546009ee043" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.015327] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.015495] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.015589] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.015704] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.015831] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.016027] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.016100] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.016221] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b069d377-c59c-4f56-8831-a284c29b3f31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.016341] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.016481] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.016554] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.016665] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6a050294-bf61-423f-b50c-cccbf8fa309f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.016789] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.016925] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.017012] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.017129] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-bf700520-a5f6-400c-a90d-a385e198aebe" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.017250] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.017387] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.017460] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.017568] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-e12852c1-7dc2-4ed2-bd34-e396f9f9256d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.017689] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.017825] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.017897] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.018017] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-14691ab9-6ef7-4499-a5c8-0c1a0b5a8191" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.018145] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.018284] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.018353] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.018458] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-62257f18-fec2-4d84-abfc-4bb2cbec54bc" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.018578] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.018713] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.018786] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.018895] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ee8e701d-05aa-43ae-8307-095303edba0f" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.019099] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.019275] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.019368] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.019491] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-aba51398-48dc-4f5e-b3cf-1da4130d58fb" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.053456] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.053651] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.053651] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.053894] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.053988] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.054135] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-afe84ec2-d66d-4a72-afc0-223b05dddb60" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.103284] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.103524] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.103597] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.103771] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.103864] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.103988] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4eb2d9d2-95c1-4cee-98cc-8a9106959838" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.167782] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8778c764-50b3-4305-af4e-70e2f924392d: rpc.has_security_group_logging(os_id): False [ 1304.170121] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.170290] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.170371] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.170659] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.170785] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.170961] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d9e364d3-a93f-4a56-a513-11d45b81aadf" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.171313] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 857afeba-8497-43a2-a5f2-438f06b14e01: rpc.has_security_group_logging(os_id): False [ 1304.177129] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.177310] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.177351] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.177570] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.177665] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.177771] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 is going to be updated. [ 1304.208145] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.208365] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.208365] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.208614] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.210905] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.211137] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.260783] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.261209] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.261327] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.261440] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.261756] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.261849] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.261942] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 857afeba-8497-43a2-a5f2-438f06b14e01 is going to be updated. [ 1304.263785] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.263872] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.284734] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.284734] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.284734] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.285133] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.285133] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.304593] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 in Status: IN_PROGRESS for 2s [ 1304.305535] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.305931] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.306157] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.306157] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.306356] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.306442] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.306533] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8778c764-50b3-4305-af4e-70e2f924392d is going to be updated. [ 1304.383700] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.383970] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.383970] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.384247] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.384247] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.423279] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 857afeba-8497-43a2-a5f2-438f06b14e01 in Status: IN_PROGRESS for 2s [ 1304.425011] env[66502]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1304.425547] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.425684] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.425754] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.426058] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.426124] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.441249] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8778c764-50b3-4305-af4e-70e2f924392d in Status: IN_PROGRESS for 2s [ 1304.992333] env[66502]: INFO networking_nsxv3.common.synchronization [req-0377b232-41b8-4778-b880-3e952f67f02b req-ae50f626-c90a-4adf-9824-750f4875c1f2 tempest-AttachVolumeTestJSON-1757376105 tempest-AttachVolumeTestJSON-1757376105-project-member] Enqueued Resource ID: 857afeba-8497-43a2-a5f2-438f06b14e01 with Priority: HIGHEST for action security_group_members [ 1304.992862] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 857afeba-8497-43a2-a5f2-438f06b14e01 with Priority: HIGHEST for action security_group_members [ 1304.993707] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-857afeba-8497-43a2-a5f2-438f06b14e01 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.993840] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-857afeba-8497-43a2-a5f2-438f06b14e01" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.993899] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-857afeba-8497-43a2-a5f2-438f06b14e01" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.994112] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-857afeba-8497-43a2-a5f2-438f06b14e01" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.994260] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1304.994360] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1304.994421] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1304.994589] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1304.994673] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1304.994780] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('857afeba-8497-43a2-a5f2-438f06b14e01',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.497530] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.497716] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.497716] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.498030] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.498138] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.498353] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.498456] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.498523] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.498669] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.498747] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.498831] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 857afeba-8497-43a2-a5f2-438f06b14e01 is going to be updated. [ 1305.529435] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.529701] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.529701] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.529895] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.530212] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.538713] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 857afeba-8497-43a2-a5f2-438f06b14e01 in Status: IN_PROGRESS for 2s [ 1306.315820] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 in Status: SUCCESS [ 1306.316098] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.439133] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 857afeba-8497-43a2-a5f2-438f06b14e01 in Status: SUCCESS [ 1306.439376] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-857afeba-8497-43a2-a5f2-438f06b14e01" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1306.454398] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8778c764-50b3-4305-af4e-70e2f924392d in Status: SUCCESS [ 1306.454679] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1307.549546] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 857afeba-8497-43a2-a5f2-438f06b14e01 in Status: SUCCESS [ 1307.549863] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 857afeba-8497-43a2-a5f2-438f06b14e01 deletion is rescheduled due to dependency. [ 1307.549863] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-857afeba-8497-43a2-a5f2-438f06b14e01" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.135014] env[66502]: INFO networking_nsxv3.common.synchronization [req-486a0d47-35ed-4b72-a82c-5e3bc3d60489 req-6532fcc6-8795-4e1f-8cb7-4bbd22e4a3fc tempest-AttachInterfacesTestJSON-1531294335 tempest-AttachInterfacesTestJSON-1531294335-project-member] Enqueued Resource ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 with Priority: HIGHEST for action security_group_members [ 1309.135604] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 with Priority: HIGHEST for action security_group_members [ 1309.136478] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-f1178ec1-223d-4ab7-9bf8-24c40a589123 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.136478] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.136478] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.136829] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.136969] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.137123] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.137190] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.137408] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.137472] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.137570] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f1178ec1-223d-4ab7-9bf8-24c40a589123',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1309.641057] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.641057] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.641057] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.641057] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.662981] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.663089] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.663212] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.663281] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.663535] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.663615] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.663706] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 is going to be updated. [ 1309.689850] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1309.690077] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1309.690077] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1309.690260] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1309.690394] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1309.699298] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 in Status: IN_PROGRESS for 2s [ 1311.710441] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 in Status: SUCCESS [ 1311.710860] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f1178ec1-223d-4ab7-9bf8-24c40a589123 deletion is rescheduled due to dependency. [ 1311.710860] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f1178ec1-223d-4ab7-9bf8-24c40a589123" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.494479] env[66502]: INFO networking_nsxv3.common.synchronization [req-c382fc51-7fde-49d2-b249-bc72f3979cd7 req-dddfb7c3-4886-4e24-80c7-d99cdbbf9763 tempest-ServerActionsTestOtherB-501490242 tempest-ServerActionsTestOtherB-501490242-project-member] Enqueued Resource ID: 670eb61a-b688-45b2-9400-64232c7b8af0 with Priority: HIGHEST for action security_group_members [ 1312.495037] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 670eb61a-b688-45b2-9400-64232c7b8af0 with Priority: HIGHEST for action security_group_members [ 1312.495346] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-670eb61a-b688-45b2-9400-64232c7b8af0 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.495461] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.495545] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.495729] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.496037] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.496037] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.496037] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.496196] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1312.496299] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1312.496356] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('670eb61a-b688-45b2-9400-64232c7b8af0',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1312.998693] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1312.999034] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1312.999034] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1312.999140] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.021882] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.022162] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.022280] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.022356] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.022599] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.022691] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.022784] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 670eb61a-b688-45b2-9400-64232c7b8af0 is going to be updated. [ 1313.048152] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.048358] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.048358] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.048556] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.048698] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.059871] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 670eb61a-b688-45b2-9400-64232c7b8af0 in Status: IN_PROGRESS for 2s [ 1313.632196] env[66502]: INFO networking_nsxv3.common.synchronization [None req-0b83aca5-bc3a-4088-86a2-7c7dd54a4938 tempest-AttachInterfacesTestJSON-1531294335 tempest-AttachInterfacesTestJSON-1531294335-project-member] Enqueued Resource ID: 3f796883-7322-4113-bfa9-5a64b4903a46 with Priority: HIGHEST for action security_group_members [ 1313.632812] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f796883-7322-4113-bfa9-5a64b4903a46 with Priority: HIGHEST for action security_group_members [ 1313.633166] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-3f796883-7322-4113-bfa9-5a64b4903a46 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.633268] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.633312] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.633885] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.633885] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.633885] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.633885] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.634137] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.634137] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.634200] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3f796883-7322-4113-bfa9-5a64b4903a46',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.137044] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.137588] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.137588] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.137588] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.159958] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.160342] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.160566] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.160687] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.161050] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.161172] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.161279] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f796883-7322-4113-bfa9-5a64b4903a46 is going to be updated. [ 1314.187781] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.188036] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.188036] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.188380] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.188639] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.197288] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f796883-7322-4113-bfa9-5a64b4903a46 in Status: IN_PROGRESS for 2s [ 1315.070220] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 670eb61a-b688-45b2-9400-64232c7b8af0 in Status: SUCCESS [ 1315.070403] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 670eb61a-b688-45b2-9400-64232c7b8af0 deletion is rescheduled due to dependency. [ 1315.070576] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-670eb61a-b688-45b2-9400-64232c7b8af0" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1316.208320] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3f796883-7322-4113-bfa9-5a64b4903a46 in Status: SUCCESS [ 1316.208655] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3f796883-7322-4113-bfa9-5a64b4903a46 deletion is rescheduled due to dependency. [ 1316.208655] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3f796883-7322-4113-bfa9-5a64b4903a46" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.634547] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1318.634920] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1323.635405] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1323.635741] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1328.636176] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1328.636616] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1333.408933] env[66502]: INFO networking_nsxv3.common.synchronization [req-f6a85ef8-5b87-460e-bc64-6708fdff5cf8 req-17d741db-f25f-455d-86eb-e250897628e9 tempest-AttachVolumeShelveTestJSON-163785099 tempest-AttachVolumeShelveTestJSON-163785099-project-member] Enqueued Resource ID: a5eea73e-9fb6-401e-a5a6-756487d3d58d with Priority: HIGHEST for action security_group_members [ 1333.409181] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5eea73e-9fb6-401e-a5a6-756487d3d58d with Priority: HIGHEST for action security_group_members [ 1333.409850] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5eea73e-9fb6-401e-a5a6-756487d3d58d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.409850] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5eea73e-9fb6-401e-a5a6-756487d3d58d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.409850] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5eea73e-9fb6-401e-a5a6-756487d3d58d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.409850] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5eea73e-9fb6-401e-a5a6-756487d3d58d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.410117] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.410117] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.410117] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.410252] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.410292] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.410870] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5eea73e-9fb6-401e-a5a6-756487d3d58d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.912419] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.912700] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.912700] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.912911] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.934763] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.935079] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.935258] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.935356] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.935584] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.935693] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.935792] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5eea73e-9fb6-401e-a5a6-756487d3d58d is going to be updated. [ 1333.963674] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.963887] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.963887] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.964045] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.964225] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.972690] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5eea73e-9fb6-401e-a5a6-756487d3d58d in Status: IN_PROGRESS for 2s [ 1335.985459] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5eea73e-9fb6-401e-a5a6-756487d3d58d in Status: SUCCESS [ 1335.985867] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5eea73e-9fb6-401e-a5a6-756487d3d58d deletion is rescheduled due to dependency. [ 1335.985867] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5eea73e-9fb6-401e-a5a6-756487d3d58d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.409708] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1338.410219] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1343.411365] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1343.411365] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1348.412446] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1348.412754] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1348.745665] env[66502]: INFO networking_nsxv3.common.synchronization [req-14ed5094-6190-45fe-8dcb-7adf9c407019 req-8f46899e-3ba7-462f-acf7-22a5cbe73690 tempest-ServerActionsTestOtherA-1204678764 tempest-ServerActionsTestOtherA-1204678764-project-member] Enqueued Resource ID: 16e42bc2-4203-42a4-85a6-b34ec02b298e with Priority: HIGHEST for action security_group_members [ 1348.746219] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e42bc2-4203-42a4-85a6-b34ec02b298e with Priority: HIGHEST for action security_group_members [ 1348.746574] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-16e42bc2-4203-42a4-85a6-b34ec02b298e taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.746734] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-16e42bc2-4203-42a4-85a6-b34ec02b298e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.746792] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-16e42bc2-4203-42a4-85a6-b34ec02b298e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.746949] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-16e42bc2-4203-42a4-85a6-b34ec02b298e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.747137] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1348.747251] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1348.747342] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1348.747627] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1348.747627] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1348.747779] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('16e42bc2-4203-42a4-85a6-b34ec02b298e',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1349.251663] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.251898] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.251992] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.252255] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.274294] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.274541] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.274656] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.274724] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.274920] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.275010] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.275104] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16e42bc2-4203-42a4-85a6-b34ec02b298e is going to be updated. [ 1349.323765] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1349.324018] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1349.324018] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1349.324202] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1349.324383] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1349.334412] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e42bc2-4203-42a4-85a6-b34ec02b298e in Status: IN_PROGRESS for 2s [ 1351.345661] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 16e42bc2-4203-42a4-85a6-b34ec02b298e in Status: SUCCESS [ 1351.346132] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 16e42bc2-4203-42a4-85a6-b34ec02b298e deletion is rescheduled due to dependency. [ 1351.346183] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-16e42bc2-4203-42a4-85a6-b34ec02b298e" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1353.746814] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1353.747232] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1358.410033] env[66502]: INFO networking_nsxv3.common.synchronization [req-20e96c22-adc8-4e6d-ac8f-a720f4541130 req-2d85b238-3c78-4ec7-b268-23701a2c27c5 tempest-ServerActionsTestOtherA-1204678764 tempest-ServerActionsTestOtherA-1204678764-project-member] Enqueued Resource ID: da4454aa-c9b4-48df-a3af-94b687746e31 with Priority: HIGHEST for action security_group_members [ 1358.410033] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da4454aa-c9b4-48df-a3af-94b687746e31 with Priority: HIGHEST for action security_group_members [ 1358.410033] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-da4454aa-c9b4-48df-a3af-94b687746e31 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.410033] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.410033] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.410033] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.410033] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.410033] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.410033] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.410560] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.410560] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.410560] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da4454aa-c9b4-48df-a3af-94b687746e31',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.681357] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-170 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.681561] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-170" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.681685] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-170" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.681950] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-170" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.682224] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.682384] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.682499] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.682706] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.682846] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.683101] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1358.683218] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1358.683324] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1358.683429] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1358.683536] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1358.683654] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1358.683763] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1358.705237] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1358.705465] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1358.705561] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1358.705708] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-170" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.706037] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-1883c339-83a0-4189-b067-9c4c6ff23841 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.706216] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-1883c339-83a0-4189-b067-9c4c6ff23841" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.706335] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-1883c339-83a0-4189-b067-9c4c6ff23841" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.706663] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-1883c339-83a0-4189-b067-9c4c6ff23841" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.706797] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1883c339-83a0-4189-b067-9c4c6ff23841',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1358.912059] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.912340] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.912340] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.912501] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.912595] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.912793] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.912894] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.912969] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.913161] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.913236] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.913318] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da4454aa-c9b4-48df-a3af-94b687746e31 is going to be deleted. [ 1358.945690] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1358.945961] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1358.945961] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1358.946112] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1358.946211] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1358.946312] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.209232] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.209543] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.209731] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.210187] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.210416] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.210671] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port 1883c339-83a0-4189-b067-9c4c6ff23841 not found, creating... [ 1359.211113] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.211388] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.211589] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.211938] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.212182] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.212650] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.212902] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.213161] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.213504] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.213731] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.213952] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: 1883c339-83a0-4189-b067-9c4c6ff23841 is going to be created. [ 1359.235029] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.235263] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.235392] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.237565] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.237818] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.238045] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-1883c339-83a0-4189-b067-9c4c6ff23841" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.931123] env[66502]: INFO networking_nsxv3.common.synchronization [req-20e96c22-adc8-4e6d-ac8f-a720f4541130 req-37765c3c-0efb-4112-9d5c-4ff4e68ae278 service nova] Enqueued Resource ID: da4454aa-c9b4-48df-a3af-94b687746e31 with Priority: HIGHEST for action security_group_rules [ 1359.931474] env[66502]: INFO networking_nsxv3.common.synchronization [req-20e96c22-adc8-4e6d-ac8f-a720f4541130 req-37765c3c-0efb-4112-9d5c-4ff4e68ae278 service nova] Enqueued Resource ID: da4454aa-c9b4-48df-a3af-94b687746e31 with Priority: HIGHEST for action security_group_members [ 1359.931474] env[66502]: INFO networking_nsxv3.common.synchronization [req-20e96c22-adc8-4e6d-ac8f-a720f4541130 req-37765c3c-0efb-4112-9d5c-4ff4e68ae278 service nova] Enqueued Resource ID: 1883c339-83a0-4189-b067-9c4c6ff23841 with Priority: HIGHEST for action port [ 1359.931938] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da4454aa-c9b4-48df-a3af-94b687746e31 with Priority: HIGHEST for action security_group_rules [ 1359.932077] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da4454aa-c9b4-48df-a3af-94b687746e31 with Priority: HIGHEST for action security_group_members [ 1359.932152] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1883c339-83a0-4189-b067-9c4c6ff23841 with Priority: HIGHEST for action port [ 1359.932434] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-da4454aa-c9b4-48df-a3af-94b687746e31 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.932516] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.932579] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.932761] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.932840] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('da4454aa-c9b4-48df-a3af-94b687746e31',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.933711] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-da4454aa-c9b4-48df-a3af-94b687746e31 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.933819] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.933886] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.934075] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.934218] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.934313] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.934385] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.934508] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.934755] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1359.934755] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da4454aa-c9b4-48df-a3af-94b687746e31',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1359.935404] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-1883c339-83a0-4189-b067-9c4c6ff23841 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1359.935506] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1883c339-83a0-4189-b067-9c4c6ff23841" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1359.935569] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1883c339-83a0-4189-b067-9c4c6ff23841" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1359.935718] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1883c339-83a0-4189-b067-9c4c6ff23841" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1359.935791] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1883c339-83a0-4189-b067-9c4c6ff23841',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.437645] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('da4454aa-c9b4-48df-a3af-94b687746e31',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1360.438634] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-da4454aa-c9b4-48df-a3af-94b687746e31 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.438752] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.438906] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1883c339-83a0-4189-b067-9c4c6ff23841 with status ACTIVE [ 1360.439077] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.439186] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.439287] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.439483] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.439575] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.439749] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.439850] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.439918] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.440077] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.440156] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.440331] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.440905] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.440905] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.440905] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.440905] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.440905] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1883c339-83a0-4189-b067-9c4c6ff23841 is going to be updated. [ 1360.462275] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1360.462516] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1360.462516] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1360.462686] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1360.462818] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.463026] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1883c339-83a0-4189-b067-9c4c6ff23841" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1360.943078] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('da4454aa-c9b4-48df-a3af-94b687746e31',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1361.445406] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.445583] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.445641] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.445861] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.445945] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.446062] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da4454aa-c9b4-48df-a3af-94b687746e31 is going to be created. [ 1361.473728] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1361.473931] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1361.473931] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1361.474191] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1361.474405] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1361.485488] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da4454aa-c9b4-48df-a3af-94b687746e31 in Status: UNINITIALIZED for 2s [ 1363.497622] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da4454aa-c9b4-48df-a3af-94b687746e31 in Status: SUCCESS [ 1363.498148] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.498148] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.498287] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.498459] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1363.498573] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1363.498657] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1363.498820] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1363.498902] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.498988] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1363.499093] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('da4454aa-c9b4-48df-a3af-94b687746e31',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1364.001673] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-da4454aa-c9b4-48df-a3af-94b687746e31 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.001974] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.001974] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.002084] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.002272] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.002366] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.002446] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.002588] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.002697] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.002796] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.002947] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-da4454aa-c9b4-48df-a3af-94b687746e31 taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.003078] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.003156] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.003287] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.003428] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.003509] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.003588] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.003754] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.003838] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.003921] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.004021] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('da4454aa-c9b4-48df-a3af-94b687746e31',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1364.506793] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for da4454aa-c9b4-48df-a3af-94b687746e31: rpc.has_security_group_logging(os_id): False [ 1364.529052] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.529294] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.529294] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.529473] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.529562] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.529776] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.529938] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.529938] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.530099] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.530169] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.530335] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.530429] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.530481] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.530618] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.530690] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.530861] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.530950] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.531012] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.531183] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.531259] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.531345] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: da4454aa-c9b4-48df-a3af-94b687746e31 is going to be created. [ 1364.595164] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1364.595405] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1364.595405] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1364.595566] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1364.595740] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1364.606767] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da4454aa-c9b4-48df-a3af-94b687746e31 in Status: IN_PROGRESS for 2s [ 1364.933615] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1364.933845] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1366.622927] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: da4454aa-c9b4-48df-a3af-94b687746e31 in Status: SUCCESS [ 1366.623397] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.284077] env[66502]: INFO networking_nsxv3.common.synchronization [req-1df52272-21aa-4b1b-9a16-6617942c855e req-6ddae721-435d-46a4-83d5-f88a1ae365f9 tempest-ServerActionsTestOtherA-1204678764 tempest-ServerActionsTestOtherA-1204678764-project-member] Enqueued Resource ID: da4454aa-c9b4-48df-a3af-94b687746e31 with Priority: HIGHEST for action security_group_members [ 1367.284645] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: da4454aa-c9b4-48df-a3af-94b687746e31 with Priority: HIGHEST for action security_group_members [ 1367.284951] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-da4454aa-c9b4-48df-a3af-94b687746e31 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.285079] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.285145] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.285339] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.285549] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.285666] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.285666] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.285805] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.286016] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.286016] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('da4454aa-c9b4-48df-a3af-94b687746e31',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.327655] env[66502]: INFO networking_nsxv3.common.synchronization [req-1df52272-21aa-4b1b-9a16-6617942c855e req-6ddae721-435d-46a4-83d5-f88a1ae365f9 tempest-ServerActionsTestOtherA-1204678764 tempest-ServerActionsTestOtherA-1204678764-project-member] Enqueued Resource ID: 1883c339-83a0-4189-b067-9c4c6ff23841 with Priority: HIGHEST for action port [ 1367.328163] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1883c339-83a0-4189-b067-9c4c6ff23841 with Priority: HIGHEST for action port [ 1367.328677] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-1883c339-83a0-4189-b067-9c4c6ff23841 taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.328799] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1883c339-83a0-4189-b067-9c4c6ff23841" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.328865] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1883c339-83a0-4189-b067-9c4c6ff23841" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.329088] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1883c339-83a0-4189-b067-9c4c6ff23841" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.329169] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1883c339-83a0-4189-b067-9c4c6ff23841',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1367.789333] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.789675] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.789675] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.789970] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.790127] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.790423] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.790578] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.790660] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.790888] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.791010] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.791175] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da4454aa-c9b4-48df-a3af-94b687746e31 is going to be updated. [ 1367.822403] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.822579] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.822622] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.822839] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.822979] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.831599] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1883c339-83a0-4189-b067-9c4c6ff23841 with status ACTIVE [ 1367.831825] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.831996] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.832056] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.832232] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.832314] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.832505] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.832605] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.832663] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.832803] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.832869] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.833072] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.833185] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.833238] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.833378] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.833450] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.833531] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1883c339-83a0-4189-b067-9c4c6ff23841 is going to be updated. [ 1367.844924] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da4454aa-c9b4-48df-a3af-94b687746e31 in Status: IN_PROGRESS for 2s [ 1367.867993] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1367.868167] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1367.868278] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1367.868434] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1367.868568] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1367.868726] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1883c339-83a0-4189-b067-9c4c6ff23841" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1369.859257] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: da4454aa-c9b4-48df-a3af-94b687746e31 in Status: SUCCESS [ 1369.859676] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: da4454aa-c9b4-48df-a3af-94b687746e31 deletion is rescheduled due to dependency. [ 1369.859676] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-da4454aa-c9b4-48df-a3af-94b687746e31" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1372.329125] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1372.329536] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1377.329891] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1377.330289] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1382.331130] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1382.331551] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1387.332372] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1387.332751] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1391.551305] env[66502]: INFO networking_nsxv3.common.synchronization [req-97705fcc-0256-4534-bf7b-a39010c05e58 req-ed7a45da-3185-4f9c-8c18-c8f928794d20 tempest-ServerActionsTestOtherA-1204678764 tempest-ServerActionsTestOtherA-1204678764-project-member] Enqueued Resource ID: 8778c764-50b3-4305-af4e-70e2f924392d with Priority: HIGHEST for action security_group_members [ 1391.551305] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8778c764-50b3-4305-af4e-70e2f924392d with Priority: HIGHEST for action security_group_members [ 1391.551683] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-8778c764-50b3-4305-af4e-70e2f924392d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.551739] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.551835] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.551998] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.552374] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.552374] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.552374] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.552564] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.552602] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.552679] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8778c764-50b3-4305-af4e-70e2f924392d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1391.804751] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock network-170 taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.804942] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "network-170" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.805079] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "network-170" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.805351] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "network-170" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.805591] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.805958] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.806096] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.806317] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.806468] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.806671] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1391.806783] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] NeedRegenerationException {{(pid=66502) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1391.806889] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] no value, waiting for create lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1391.806993] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] value creation lock acquired {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1391.807113] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] No value present for key: 'zone-id' {{(pid=66502) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1391.807218] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Calling creation function for not-yet-present value {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1391.807347] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1391.828258] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1391.828509] env[66502]: DEBUG dogpile.cache.region [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=66502) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1391.828656] env[66502]: DEBUG dogpile.lock [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Released creation lock {{(pid=66502) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1391.828911] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "network-170" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.829307] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock port-87b3c08d-1cf7-49c2-922d-d40a1f5d91ab taken with stack trace [, , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1391.829526] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "port-87b3c08d-1cf7-49c2-922d-d40a1f5d91ab" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1391.829670] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "port-87b3c08d-1cf7-49c2-922d-d40a1f5d91ab" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1391.829993] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "port-87b3c08d-1cf7-49c2-922d-d40a1f5d91ab" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1391.830146] env[66502]: DEBUG networking_nsxv3.api.rpc [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87b3c08d-1cf7-49c2-922d-d40a1f5d91ab',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.054967] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8778c764-50b3-4305-af4e-70e2f924392d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1392.333014] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.333261] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.333408] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.333729] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.333889] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.334093] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Segment Port 87b3c08d-1cf7-49c2-922d-d40a1f5d91ab not found, creating... [ 1392.334378] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.334581] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.334741] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.335099] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.335165] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.335410] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.335568] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.335687] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.335922] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.336072] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.336212] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Resource: SegmentPort with ID: 87b3c08d-1cf7-49c2-922d-d40a1f5d91ab is going to be created. [ 1392.357460] env[66502]: DEBUG networking_nsxv3.common.locking [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1392.357683] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1392.357806] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1392.358107] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1392.358335] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.358558] env[66502]: DEBUG oslo_concurrency.lockutils [None req-a9828499-0583-44b4-b81b-9978d23c13db None None] Releasing lock "port-87b3c08d-1cf7-49c2-922d-d40a1f5d91ab" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1392.557552] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8778c764-50b3-4305-af4e-70e2f924392d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1393.033167] env[66502]: INFO networking_nsxv3.common.synchronization [req-97705fcc-0256-4534-bf7b-a39010c05e58 req-339c4ee3-6f47-4560-9804-558aaac28b38 service nova] Enqueued Resource ID: 8778c764-50b3-4305-af4e-70e2f924392d with Priority: HIGHEST for action security_group_rules [ 1393.033712] env[66502]: INFO networking_nsxv3.common.synchronization [req-97705fcc-0256-4534-bf7b-a39010c05e58 req-339c4ee3-6f47-4560-9804-558aaac28b38 service nova] Enqueued Resource ID: 8778c764-50b3-4305-af4e-70e2f924392d with Priority: HIGHEST for action security_group_members [ 1393.033712] env[66502]: INFO networking_nsxv3.common.synchronization [req-97705fcc-0256-4534-bf7b-a39010c05e58 req-339c4ee3-6f47-4560-9804-558aaac28b38 service nova] Enqueued Resource ID: 87b3c08d-1cf7-49c2-922d-d40a1f5d91ab with Priority: HIGHEST for action port [ 1393.033712] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8778c764-50b3-4305-af4e-70e2f924392d with Priority: HIGHEST for action security_group_rules [ 1393.033995] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8778c764-50b3-4305-af4e-70e2f924392d with Priority: HIGHEST for action security_group_members [ 1393.033995] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 87b3c08d-1cf7-49c2-922d-d40a1f5d91ab with Priority: HIGHEST for action port [ 1393.034494] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8778c764-50b3-4305-af4e-70e2f924392d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.034654] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.034751] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.034960] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.035066] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8778c764-50b3-4305-af4e-70e2f924392d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1393.035952] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-8778c764-50b3-4305-af4e-70e2f924392d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.036122] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.036264] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock port-87b3c08d-1cf7-49c2-922d-d40a1f5d91ab taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.036358] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-87b3c08d-1cf7-49c2-922d-d40a1f5d91ab" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.036415] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-87b3c08d-1cf7-49c2-922d-d40a1f5d91ab" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.036581] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-87b3c08d-1cf7-49c2-922d-d40a1f5d91ab" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.036655] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('87b3c08d-1cf7-49c2-922d-d40a1f5d91ab',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1393.059976] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.060193] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.060193] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.060360] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.060437] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.060535] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8778c764-50b3-4305-af4e-70e2f924392d is going to be updated. [ 1393.087261] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.087545] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.087545] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.087671] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.087796] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.096313] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8778c764-50b3-4305-af4e-70e2f924392d in Status: IN_PROGRESS for 2s [ 1393.539101] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-8778c764-50b3-4305-af4e-70e2f924392d taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.539101] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.539101] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 87b3c08d-1cf7-49c2-922d-d40a1f5d91ab with status ACTIVE [ 1393.539101] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.539101] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.539101] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.539497] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.539497] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.539497] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.539623] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.539660] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.539921] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.540009] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.540203] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.540458] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.540458] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.540634] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.540736] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.540821] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 87b3c08d-1cf7-49c2-922d-d40a1f5d91ab is going to be updated. [ 1393.563342] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1393.563788] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1393.563788] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1393.563788] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1393.563893] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.564169] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-87b3c08d-1cf7-49c2-922d-d40a1f5d91ab" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.106129] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8778c764-50b3-4305-af4e-70e2f924392d in Status: SUCCESS [ 1395.106543] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.106850] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.107091] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.107278] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1395.107391] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1395.107457] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1395.107597] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1395.107677] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1395.107771] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8778c764-50b3-4305-af4e-70e2f924392d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1395.610741] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8778c764-50b3-4305-af4e-70e2f924392d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1396.112527] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8778c764-50b3-4305-af4e-70e2f924392d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1396.615562] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.615827] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.615827] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.616050] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.616148] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.616251] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8778c764-50b3-4305-af4e-70e2f924392d is going to be updated. [ 1396.647682] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1396.647916] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1396.647916] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1396.648061] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1396.648203] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1396.658404] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8778c764-50b3-4305-af4e-70e2f924392d in Status: IN_PROGRESS for 2s [ 1398.035642] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1398.035642] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1398.671482] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8778c764-50b3-4305-af4e-70e2f924392d in Status: SUCCESS [ 1398.671482] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.671744] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.671889] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.672092] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1398.672208] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1398.672271] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1398.672432] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1398.672511] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.672596] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1398.672686] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8778c764-50b3-4305-af4e-70e2f924392d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1399.174556] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8778c764-50b3-4305-af4e-70e2f924392d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1399.676280] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8778c764-50b3-4305-af4e-70e2f924392d: rpc.has_security_group_logging(os_id): False [ 1399.693932] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.694188] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.694188] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.694369] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.694459] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.694718] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.694820] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.694874] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.695039] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.695120] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.695204] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8778c764-50b3-4305-af4e-70e2f924392d is going to be updated. [ 1399.764254] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1399.764554] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1399.764554] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1399.764679] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1399.764820] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1399.782485] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8778c764-50b3-4305-af4e-70e2f924392d in Status: IN_PROGRESS for 2s [ 1401.796966] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8778c764-50b3-4305-af4e-70e2f924392d in Status: SUCCESS [ 1401.796966] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1403.037027] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1403.037394] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1408.037964] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1408.038407] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1413.039096] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1413.039510] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1418.040642] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1418.041015] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1423.042285] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1423.042686] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1428.043520] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1428.043520] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1433.044419] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1433.044801] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1438.046288] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1438.046766] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1443.047627] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1443.048357] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1448.050155] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1448.050646] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1453.051392] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1453.051818] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1458.053178] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1458.053584] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1458.592158] env[66502]: INFO networking_nsxv3.common.synchronization [req-c372beef-f248-49cd-b6aa-1607835493ed req-c7007ea8-acbc-4a9a-b017-5b9626b0cf77 tempest-ServerActionsTestOtherA-1204678764 tempest-ServerActionsTestOtherA-1204678764-project-member] Enqueued Resource ID: 8778c764-50b3-4305-af4e-70e2f924392d with Priority: HIGHEST for action security_group_members [ 1458.592158] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8778c764-50b3-4305-af4e-70e2f924392d with Priority: HIGHEST for action security_group_members [ 1458.592413] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-8778c764-50b3-4305-af4e-70e2f924392d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1458.592531] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1458.592599] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1458.592793] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1458.592939] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1458.593046] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1458.593104] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1458.593276] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1458.593380] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1458.593424] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8778c764-50b3-4305-af4e-70e2f924392d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1459.095099] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8778c764-50b3-4305-af4e-70e2f924392d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1459.597676] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8778c764-50b3-4305-af4e-70e2f924392d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1460.101563] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.102080] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.102080] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.102080] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.102204] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.102238] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8778c764-50b3-4305-af4e-70e2f924392d is going to be updated. [ 1460.137695] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1460.137908] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1460.137908] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1460.138102] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1460.138250] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1460.147256] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8778c764-50b3-4305-af4e-70e2f924392d in Status: IN_PROGRESS for 2s [ 1462.158221] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8778c764-50b3-4305-af4e-70e2f924392d in Status: SUCCESS [ 1462.158664] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1463.593753] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1463.594239] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1468.594775] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1468.595207] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1473.596318] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1473.596823] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1474.871669] env[66502]: INFO networking_nsxv3.common.synchronization [req-f1cd6b6e-3233-4bbd-aa25-dbba2393ca4b req-a90a2b10-a4fc-4370-b341-c5d637cfbbca tempest-ServerActionsTestOtherA-1204678764 tempest-ServerActionsTestOtherA-1204678764-project-member] Enqueued Resource ID: 8778c764-50b3-4305-af4e-70e2f924392d with Priority: HIGHEST for action security_group_members [ 1474.871669] env[66502]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8778c764-50b3-4305-af4e-70e2f924392d with Priority: HIGHEST for action security_group_members [ 1474.872041] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock member-8778c764-50b3-4305-af4e-70e2f924392d taken with stack trace [, , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.872041] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.872041] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1474.872334] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1474.872431] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1474.872528] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1474.872595] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1474.872738] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1474.872827] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1474.872924] env[66502]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8778c764-50b3-4305-af4e-70e2f924392d',) {} {{(pid=66502) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1475.377687] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1475.377920] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1475.377920] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1475.378206] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1475.378319] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1475.378519] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1475.378942] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1475.378942] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1475.378942] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1475.378942] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1475.379246] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8778c764-50b3-4305-af4e-70e2f924392d is going to be updated. [ 1475.405118] env[66502]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=66502) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1475.405342] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1475.405342] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1475.405546] env[66502]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1475.405683] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1475.415303] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8778c764-50b3-4305-af4e-70e2f924392d in Status: IN_PROGRESS for 2s [ 1477.429277] env[66502]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8778c764-50b3-4305-af4e-70e2f924392d in Status: SUCCESS [ 1477.429685] env[66502]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8778c764-50b3-4305-af4e-70e2f924392d deletion is rescheduled due to dependency. [ 1477.429685] env[66502]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8778c764-50b3-4305-af4e-70e2f924392d" {{(pid=66502) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1479.872500] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1479.872500] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1484.873113] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1484.873552] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1489.044588] env[66502]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] NSXv3 Agent Agent loop - iteration:3 completed [ 1489.045055] env[66502]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-2d87ae8e-a622-4189-a3e7-cf98202aadf3 None None] NSXv3 Agent Agent loop - iteration:4 started [ 1489.874237] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1489.874435] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1494.875271] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1494.875701] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1499.876480] env[66502]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1499.876883] env[66502]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0